Predicting the future location of vehicles is essential for safety-critical applications such as advanced driver assistance systems (ADAS) and autonomous driving. This paper introduces a novel approach to simultaneously predict both the location and scale of target vehicles in the first-person (egocentric) view of an ego-vehicle. We present a multi-stream recurrent neural network (RNN) encoder-decoder model that separately captures both object location and scale and pixel-level observations for future vehicle localization. We show that incorporating dense optical flow improves prediction results significantly since it captures information about motion as well as appearance change. We also find that explicitly modeling future motion of the ego-vehicle improves the prediction accuracy, which could be especially beneficial in intelligent and automated vehicles that have motion planning capability. To evaluate the performance of our approach, we present a new dataset of first-person videos collected from a variety of scenarios at road intersections, which are particularly challenging moments for prediction because vehicle trajectories are diverse and dynamic.


    Access

    Download


    Export, share and cite



    Title :

    Egocentric Vision-based Future Vehicle Localization for Intelligent Driving Assistance Systems


    Contributors:
    Yao, Yu (author) / Xu, Mingze (author) / Choi, Chiho (author) / Crandall, David J. (author) / Atkins, Ella M. (author) / Dariush, Behzad (author)

    Publication date :

    2018


    Remarks:

    To appear on ICRA 2019


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    SYSTEM AND METHOD FOR EGOCENTRIC VISION-BASED FUTURE VEHICLE LOCALIZATION

    YAO YU / XU MINGZE / CHOI CHIHO et al. | European Patent Office | 2020

    Free access

    System and method for egocentric-vision based future vehicle localization

    YAO YU / XU MINGZE / CHOI CHIHO et al. | European Patent Office | 2021

    Free access

    SYSTEM AND METHOD FOR EGOCENTRIC-VISION BASED FUTURE VEHICLE LOCALIZATION

    YAO YU / XU MINGZE / CHOI CHIHO et al. | European Patent Office | 2020

    Free access

    VEHICLE DRIVING INTELLIGENT ASSISTANCE SYSTEM

    ZHAO JINGBO / LIAO LIANYING / LIU HAIMEI et al. | European Patent Office | 2024

    Free access

    Vehicle-mounted intelligent driving assistance system

    YU YANG | European Patent Office | 2021

    Free access