Robust sensor fusion is a key technology for enabling the safe operation of automated vehicles. Sensor fusion typically utilizes inputs of cameras, radars, lidar, inertial measurement unit, and global navigation satellite systems, process them, and then output object detection or positioning data. This paper will focus on sensor fusion between the camera, radar, and vehicle wheel speed sensors which is a critical need for near-term realization of sensor fusion benefits. The camera is an off-the-shelf computer vision product from MobilEye and the radar is a Delphi/Aptive electronically scanning radar (ESR) both of which are connected to a drive-by-wire capable vehicle platform. We utilize the MobilEye and wheel speed sensors to create a dynamic region of interest (DROI) of the drivable region that changes as the vehicle moves through the environment. The use of the DROI can reduce the need for up to approximately 100% of the detections from radar, for processing of the driveable region. This provides not only accurate and robust detections but also has benefits in lowering computational power and time complexity. We then continue to reduce the number of detections in the driveable region using machine learning techniques such as density-based spatial clustering and applications with noise (DBSCAN). This is followed by KMeans clustering to further reduce detections and lastly fused with the extended Kalman filter. Our experimental results obtained using an instrumented vehicle show a large reduction in the need for radar detections processing after both, fusion with our DROI and further clustering using machine learning techniques for the driveable region. Our proposed complete technique decreases the amount of fused misdetection, decreases computational power, and increases the reliability of the fused perception model which can greatly benefit current Advanced Driver Assistance System products available on the market today.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Higher Accuracy and Lower Computational Perception Environment Based Upon a Real-time Dynamic Region of Interest


    Additional title:

    Sae Technical Papers


    Contributors:

    Conference:

    WCX SAE World Congress Experience ; 2022



    Publication date :

    2022-03-29




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Higher Accuracy and Lower Computational Perception Environment Based Upon a Real-time Dynamic Region of Interest

    Brown, Nicolas Eric / Fanas Rojas, Johan / Alzu'bi, Hamzeh et al. | British Library Conference Proceedings | 2022


    Real-Time Dynamic Environment Perception in Driving Scenarios Using Difference Fronts

    Vatavu, A. / Danescu, R.G. / Nedevschi, S. et al. | British Library Conference Proceedings | 2012


    Real-time dynamic environment perception in driving scenarios using difference fronts

    Vatavu, Andrei / Danescu, Radu / Nedevschi, Sergiu | IEEE | 2012


    Real-time image registration algorithms based on region of interest

    Liu, Songtao / Zhou, Xiadong / Wang, Xuewei | SPIE | 2006


    STRAP V - Higher accuracy, lower drift attitude control system

    BUDNEY, T. / COLLINSON, T. / STONE, R. | AIAA | 1982