Visual environment perception is one of the key elements for autonomous and manual driving. Modern fully automated vehicles are equipped with a range of different sensors and capture the surroundings with multiple cameras. The ability to predict human driver’s attention is the basis for various autonomous driving functions. State-of-the-art attention prediction approaches use only a single front facing camera and rely on automatically generated training data. In this paper, we present a manually labeled multi-view region of interest dataset. We use our dataset to finetune a state-of-the-art region of interest prediction model for multiple camera views. Additionally, we show that using two separate models focusing on either front or rear view data improves the region of interest prediction. We further propose a semi-supervised annotation framework which uses the best performing finetuned models for generating pseudo labels to improve the efficiency of the labeling process. Our results show that existing region of interest prediction performs well on front view data, but finetuning improves the performance especially for rear view data. Our current dataset consists of about 16000 images and we plan to further increase the size of the dataset. The dataset and the source code of the proposed semi-supervised annotation framework will be made available on GitHub and can be used to generate custom region of interest data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-View Region of Interest Prediction for Autonomous Driving Using Semi-Supervised Labeling


    Contributors:


    Publication date :

    2020-09-20


    Size :

    1367655 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    An Algorithm for Supervised Driving of Cooperative Semi-Autonomous Vehicles

    Altche, Florent / Qian, Xiangjun / de La Fortelle, Arnaud | IEEE | 2017


    CONFIGURABLE ILLUMINATION ON REGION OF INTEREST FOR AUTONOMOUS DRIVING

    ZHENG BOWEN / YU XIANG / XIAO SINAN et al. | European Patent Office | 2020

    Free access

    CLASS LABELING APPARATUS FOR AUTONOMOUS DRIVING

    LEE DONG YUL / LEE JIN AEON / GIL HO PYONG et al. | European Patent Office | 2020

    Free access

    CLASS LABELING APPARATUS FOR AUTONOMOUS DRIVING

    European Patent Office | 2020

    Free access

    Ensemble-Based Semi-Supervised Learning to Improve Noisy Soiling Annotations in Autonomous Driving

    Uricar, Michal / Sistu, Ganesh / Yahiaoui, Lucie et al. | IEEE | 2021