Target detection is essential to the advanced driving assistance system (ADAS) and automatic driving. And the data fusion of millimeter wave radar and camera could provide more accurate and complete information of targets and enhance the environmental perception performance. In this paper, a method of vehicle and pedestrian detection based on the data fusion of millimeter wave radar and camera is proposed to improve the target distance estimation accuracy. The first step is the targets data acquisition. A deep learning model called Single Shot MultiBox Detector (SSD) is utilized for targets detection in consecutive video frames captured by camera and further optimized for high real-time performance and accuracy. Secondly, the coordinate system of camera and radar are unified by coordinate transformation matrix. Then, the parallel Kalman filter is used to track the targets detected by radar and camera respectively. Since targets data provided by the camera and radar are different, different Kalman filters are designed to achieve the tracking process. Finally, the targets data are fused based on Bayesian Estimation. At first, several simulation experiments were designed to test and optimize the proposed method, then the real data was used to prove further. Through experiments, it shows that the measurement noise can be considerably reduced by Kalman filter and the fusion algorithm could improve the estimation accuracy.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Camera-Radar Data Fusion for Target Detection via Kalman Filter and Bayesian Estimation


    Additional title:

    Sae Technical Papers


    Contributors:
    Bai, Jie (author) / Huang, Libo (author) / Chen, Sihan (author) / Bi, Xin (author) / Yu, Zhexiang (author)

    Conference:

    Intelligent and Connected Vehicles Symposium ; 2018



    Publication date :

    2018-08-07




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Distance Estimation by Fusing Radar and Monocular Camera with Kalman Filter

    Brace, Chris / Chappell, Edward / iravani PhD, Pejman et al. | SAE Technical Papers | 2017




    Target Detection Algorithm Based on MMW Radar and Camera Fusion*

    Jiang, Qiuyu / Zhang, Lijun / Meng, Dejian | IEEE | 2019


    Millimeter Wave Radar Target Tracking Based on Adaptive Kalman Filter

    Zhai, Guangyao. / Wu, Cheng / Wang, Yiming | IEEE | 2018