Multi-target tracking is the cornerstone of autonomous driving. Only on this basis can we achieve tracking and path planning. Detection problem is an important part of environment perception system. Therefore, it has become a hot spot in related fields such as computer vision and autonomous driving. 3D object detection adds more information than 2D object detection, such as size, depth, pose, etc. However, the 3D information obtained based on the image, especially the depth, is very inaccurate, so that the detection frame information has a large deviation. The trajectory tracking ability based on these detection results is also reduced accordingly. Our research proposes a method to detect 3D information by combining data from cameras and mmWave radar. We then apply this result to the multi-object tracking problem. It achieves a MOTA of 70.0 and a IDF1 of 73.1 on the NuScenes dataset.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    3D Multi-Object Tracking Based on Radar-Camera Fusion


    Contributors:
    Lin, Zihao (author) / Hu, Jianming (author)


    Publication date :

    2022-10-08


    Size :

    505120 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    CFTrack: Center-based Radar and Camera Fusion for 3D Multi-Object Tracking

    Nabati, Ramin / Harris, Landon / Qi, Hairong | IEEE | 2021


    Multiple camera fusion for multi-object tracking

    Dockstader, S.L. / Tekalp, A.M. | IEEE | 2001


    Multiple Camera Fusion for Multi-Object Tracking

    Dockstader, S. L. / Tekalp, A. M. / IEEE Computer Society | British Library Conference Proceedings | 2001


    Optimization based 3D Multi-Object Tracking using Camera and Radar Data

    Poschmann, Johannes / Pfeifer, Tim / Protzel, Peter | IEEE | 2021