Object detection and tracking is a central aspect of perception for autonomous vehicles. While there has been significant development in this field in recent years, many perception algorithms still struggle to provide reliable information in challenging weather conditions which include night-time, direct sunlight, glare, fog, etc. To achieve full autonomy, there is a need for a robust perception system capable of handling such challenging conditions. In this paper, we attempt to bridge this gap by proposing an algorithm that combines the strength of automotive radars and infra-red thermal cameras. We show that these sensors complement each other well and provide reliable data in poor visibility conditions. We demonstrate the advantages of a thermal camera over a visible-range camera in these situations and employ YOLOv3 for object detection. The proposed system utilizes a modified Track-Oriented Multiple Hypothesis Tracking (MHT) algorithm which uses data from these sensors to keep track of the surrounding vehicles. The modifications in the well-known MHT algorithm were introduced in order to curb the exponential growth of possible hypotheses and consequently reduce the computational time without loss of any critical information. To validate the system, we provide a real-time implementation on an urban dataset collected at the Texas A&M University.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Object Detection and Tracking for Autonomous Vehicles in Adverse Weather Conditions


    Additional title:

    Sae Technical Papers



    Conference:

    SAE WCX Digital Summit ; 2021



    Publication date :

    2021-04-06




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Object Detection and Tracking for Autonomous Vehicles in Adverse Weather Conditions

    Bhadoriya, Abhay Singh / Vegamoor, Vamsi Krishna / Rathinam, Sivakumar | British Library Conference Proceedings | 2021


    Object Detection of Autonomous Vehicles under Adverse Weather Conditions

    Arthi, V. / Murugeswari, R. / P, Nagaraj | IEEE | 2022


    Improving Object Detection and Classification for Autonomous Vehicle in Adverse Weather Conditions

    Maruthiram, Katroth Balakrishna / Reddy, G. Venkata Rami | IEEE | 2024


    Object Detection System in Adverse Weather Conditions Using Ann

    Joshua, Jeberson A / Narasiman, L / Yogeshwaran, V et al. | IEEE | 2023


    Towards video processing in vehicles under adverse weather conditions

    Grinberg, Michael / Schneider, N. / Pagel, Frank et al. | BASE | 2012

    Free access