Multi-sensor fusion strategies have gradually become a consensus in autonomous driving research. Among them, radar-camera fusion has attracted wide attention for its improvement on the dimension and accuracy of perception at a lower cost, however, the processing and association of radar and camera data has become an obstacle to related research. Our approach is to build a concise framework for camera and radar detection and data association: for visual object detection, the state-of-the-art YOLOv5 algorithm is further improved and works as the image detector, and before the fusion process, the raw radar reflection data is projected onto image plane and hierarchically clustered, then the projected radar echoes and image detection results are matched based on the Hungarian algorithm. Thus, the category of objects and their corresponding distance and speed information can be obtained, providing reliable input for subsequent object tracking task. Results shows that the fusion method greatly improves the perception dimension and accuracy of intelligent vehicles in adverse environments, its matching accuracy reaches 62.3% on the VTTI dataset and the camera-radar association process takes 0.013s per frame. All implementation is based on ROS (Robot Operation System) to facilitate the feasible application of algorithms.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Concise Camera-Radar Fusion Framework for Object Detection and Data Association


    Weitere Titelangaben:

    Sae Technical Papers


    Beteiligte:
    Zhao, Jian (Autor:in) / Li, Linhui (Autor:in) / Lyu, Nana (Autor:in) / Liu, Pengbo (Autor:in) / He, Yingjie (Autor:in)

    Kongress:

    SAE 2022 Intelligent and Connected Vehicles Symposium ; 2022



    Erscheinungsdatum :

    2022-12-22




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    A Concise Camera-Radar Fusion Framework for Object Detection and Data Association

    He, Yingjie / Zhao, Jian / Lyu, Nana et al. | British Library Conference Proceedings | 2022


    Automated vehicle object detection system with camera image and radar data fusion

    CHEN SUSAN / SCHWARTZ DAVID A / MANGALGIRI ANURADHA et al. | Europäisches Patentamt | 2018

    Freier Zugriff

    RVDet: Feature-level Fusion of Radar and Camera for Object Detection

    Zhang, Jingwei / Zhang, Ming / Fang, Zicheng et al. | IEEE | 2021


    Deep Learning-based Radar, Camera, and Lidar Fusion for Object Detection

    Nobis, Felix Otto Geronimo | TIBKAT | 2022

    Freier Zugriff

    OBJECT DETECTION METHOD BASED ON RADAR-CAMERA FUSION AND ELECTRONIC APPARATUS

    CHUNG YOUN KYU / PARK YONG JEONG / CUI CHENGLIN et al. | Europäisches Patentamt | 2022

    Freier Zugriff