Autonomous vehicles should be capable of operating in all types of weather conditions. Drivable road region detection is a core component of the perception stack of self-driving vehicles. Current approaches for detecting road regions perform well in good weather but lack in inclement weather conditions. In this paper, we examine the effect of inclement weather on the camera-based state-of-the-art deep learning approaches and introduce a new camera and automotive radar-based multimodal deep learning model to efficiently detect drivable road regions in all weather conditions. We also propose a novel approach to overcome the sparse resolution problem of automotive radars and a way to effectively use it in higher precision tasks such as image segmentation. To validate our work, we have augmented the nuScenes data with rain and fog to add challenging weather conditions. Experimental results show that the performance of the state-of-the-art techniques drops 18% in bad weather conditions while our proposed method improves the performance by 12% compared to the state-of-the-art.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Learning Based Road Boundary Detection Using Camera and Automotive Radar


    Contributors:


    Publication date :

    2024-06-02


    Size :

    1019501 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Object boundary detection for automotive radar imaging

    STAINVAS OLSHANSKY INNA / BILIK IGAL / BIALER ODED | European Patent Office | 2019

    Free access

    APPARATUS AND METHOD FOR DETECTING ROAD BOUNDARY LINE USING CAMERA AND RADAR

    LEE HO WON / KIM HO JOON / PARK YOUNG SOON et al. | European Patent Office | 2017

    Free access


    Deep Learning-based Radar, Camera, and Lidar Fusion for Object Detection

    Nobis, Felix Otto Geronimo | TIBKAT | 2022

    Free access

    Deep Learning-Based Radar Detector for Complex Automotive Scenarios

    Franceschi, Roberto / Rachkov, Dmytro | IEEE | 2022