Existing RGB image-based object detection methods achieve high accuracy when objects are static or in quasi-static conditions but demonstrate degraded performance with fast-moving objects due to motion blur artifacts. Moreover, state-of-the-art deep learning methods, which rely on RGB images as input, necessitate training and inference on high-performance graphics cards. These cards are not only bulky and power-hungry but also challenging to deploy on compact robotic platforms. Fortunately, the emergence of event cameras, inspired by biological vision, provides a promising solution to these limitations. These cameras offer low latency, minimal motion blur, and non-redundant outputs, making them well suited for dynamic obstacle detection. Building on these advantages, a novel methodology was developed through the fusion of events with depth to address the challenge of dynamic object detection. Initially, an adaptive temporal sampling window was implemented to selectively acquire event data and supplementary information, contingent upon the presence of objects within the visual field. Subsequently, a warping transformation was applied to the event data, effectively eliminating artifacts induced by ego-motion while preserving signals originating from moving objects. Following this preprocessing stage, the transformed event data were converted into an event queue representation, upon which denoising operations were performed. Ultimately, object detection was achieved through the application of image moment analysis to the processed event queue representation. The experimental results show that, compared with the current state-of-the-art methods, the proposed method has improved the detection speed by approximately 20% and the accuracy by approximately 5%. To substantiate real-world applicability, the authors implemented a complete obstacle avoidance pipeline, integrating our detector with planning modules and successfully deploying it on a custom-built quadrotor platform. Field tests confirm reliable avoidance of an obstacle approaching at approximately 8 m/s, thereby validating practical deployment potential.


    Access

    Download


    Export, share and cite



    Title :

    A Low-Latency Dynamic Object Detection Algorithm Fusing Depth and Events


    Contributors:
    Duowen Chen (author) / Liqi Zhou (author) / Chi Guo (author)


    Publication date :

    2025




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Fusing detection device, fusing detection method, and computer program

    SAWANO SHUNICHI | European Patent Office | 2023

    Free access

    Deep car detection by fusing grayscale image and weighted upsampled LiDAR depth

    Jamshidi Seikavandi, Meisam / Nasrollahi, Kamal / Moeslund, Thomas B. | British Library Conference Proceedings | 2021


    Driver Activity Recognition by Fusing Multi-object and Key Points Detection

    Pardo-Decimavilla, Pablo / Bergasa, Luis M. / López-Guillén, Elena et al. | Springer Verlag | 2024


    Optimal sensor reading for low latency object detection

    HART SEAN | European Patent Office | 2023

    Free access

    OPTIMAL SENSOR READING FOR LOW LATENCY OBJECT DETECTION

    HART SEAN | European Patent Office | 2022

    Free access