Environmental perception is considered an essential module for autonomous driving and Advanced Driver Assistance System (ADAS). Recently, deep Convolutional Neural Networks (CNNs) have become the State-of-the-Art with many different architectures in various object detection problems. However, performances of existing CNNs have been dropping when detecting small objects at a large distance. To deploy any environmental perception system in real world applications, it is important that the system achieves high accuracy regardless of the size of the object, distance, and weather conditions. In this paper, a robust sensor fused object detection system is proposed by utilizing the advantages of both vision and automotive radar sensors. The proposed system consists of three major components: 1) the Coordinate Conversion module, 2) Multi level-Sensor Fusion Detection (MSFD) system, and 3) Temporal Correlation filtering module. The proposed MSFD system employs the principles of artificial intelligence beyond simple comparison of data variance of the sensors. And then, its performance is further improved by using the temporal correlation information with an adaptive threshold scheme. The proposed system is evaluated with the collected video data (6,854 image frames with 18,918 labeled objects). Based on the laboratory testing and in-vehicle validation, the proposed system demonstrates its high accuracy for detecting any size of objects in real-world data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Robust Sensor Fused Object Detection Using Convolutional Neural Networks for Autonomous Vehicles


    Additional title:

    Sae Technical Papers


    Contributors:

    Conference:

    WCX SAE World Congress Experience ; 2020



    Publication date :

    2020-04-14




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Robust Sensor Fused Object Detection Using Convolutional Neural Networks for Autonomous Vehicles

    Park, Jungme / Raguraman, Sriram Jayachandran / Asiam, Aakif et al. | British Library Conference Proceedings | 2020


    Robust Sensor Fused Object Detection Using Convolutional Neural Networks for Autonomous Vehicles

    Park, Jungme / Jayachandran Raguraman, Sriram / Aslam, Aakif et al. | British Library Conference Proceedings | 2020


    Convolutional Neural Networks for Object Detection

    Romão, Bruno / Fagotto, Eric | SAE Technical Papers | 2024


    Sensor-based object-detection optimization for autonomous vehicles

    LEVINSON JESSE SOL / KENTLEY-KLAY TIMOTHY DAVID / DOUILLARD BERTRAND ROBERT | European Patent Office | 2021

    Free access

    SENSOR-BASED OBJECT-DETECTION OPTIMIZATION FOR AUTONOMOUS VEHICLES

    LEVINSON JESSE SOL / KENTLEY TIMOTHY DAVID / DOUILLARD BERTRAND ROBERT | European Patent Office | 2017

    Free access