Accurate 3D tracking of objects from monocular camera poses challenges due to the loss of depth during projection. Although ranging by RADAR has proven effective in highway environments, people tracking remains beyond the capability of single sensor systems. In this paper, we propose a cooperative RADAR-camera fusion method for people tracking on the ground plane. Using average person height, joint detection likelihood is calculated by back-projecting detections from the camera onto the RADAR Range-Azimuth data. Peaks in the joint likelihood, representing candidate targets, are fed into a Particle Filter tracker. Depending on the association outcome, particles are updated using the associated detections (Tracking by Detection), or by sampling the raw likelihood itself (Tracking Before Detection). Utilizing the raw likelihood data has the advantage that lost targets are continuously tracked even if the camera or RADAR signal is below the detection threshold. We show that in single target, uncluttered environments, the proposed method entirely outperforms camera-only tracking. Experiments in a real-world urban environment also confirm that the cooperative fusion tracker produces significantly better estimates, even in difficult and ambiguous situations.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    People Tracking by Cooperative Fusion of RADAR and Camera Sensors


    Contributors:


    Publication date :

    2019-10-01


    Size :

    1083560 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    3D Multi-Object Tracking Based on Radar-Camera Fusion

    Lin, Zihao / Hu, Jianming | IEEE | 2022


    Radar and Camera Fusion based Moving Obstacle Tracking for Automated Vehicles

    Wang, Shihao / Ma, Zheng / Li, Ying et al. | IEEE | 2021


    CAMERA-RADAR FUSION USING CORRESPONDENCES

    MICHIELIN FRANCESCO / VOGEL OLIVER | European Patent Office | 2023

    Free access

    CFTrack: Center-based Radar and Camera Fusion for 3D Multi-Object Tracking

    Nabati, Ramin / Harris, Landon / Qi, Hairong | IEEE | 2021