In the event of sensor failure, autonomous vehicles need to safely execute emergency maneuvers while avoiding other vehicles on the road. To accomplish this, the sensor-failed vehicle must predict the future semantic behaviors of other drivers, such as lane changes, as well as their future trajectories given a recent window of past sensor observations. We address the first issue of semantic behavior prediction in this paper, which is a precursor to trajectory prediction, by introducing a framework that leverages the power of recurrent neural networks (RNNs) and graphical models. Our goal is to predict the future categorical driving intent, for lane changes, of neighboring vehicles up to three seconds into the future given as little as a one-second window of past LIDAR, GPS, inertial, and map data. We collect real-world data containing over 20 hours of highway driving using an autonomous Toyota vehicle. We propose a composite RNN model by adopting the methodology of Structural Recurrent Neural Networks (RNNs) to learn factor functions and take advantage of both the high-level structure of graphical models and the sequence modeling power of RNNs, which we expect to afford more transparent modeling and activity than opaque, single RNN models. To demonstrate our approach, we validate our model using authentic interstate highway driving to predict the future lane change maneuvers of other vehicles neighboring our autonomous vehicle. We find that our composite Structural RNN outperforms baselines by as much as 12% in balanced accuracy metrics.


    Access

    Download


    Export, share and cite



    Title :

    Predicting Future Lane Changes of Other Highway Vehicles using RNN-based Deep Models


    Contributors:

    Publication date :

    2018


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Predicting lane changes of other vehicles

    YANG CHUN / ANKA LASZLO / RIGO ADAM et al. | European Patent Office | 2022

    Free access

    Predicting lane changes of other vehicles

    YANG CHUN / ANKA LASZLO / RIGO ADAM et al. | European Patent Office | 2020

    Free access


    A Cooperative Lane Change Model for Connected Vehicles on Two-Lane Highway

    Sun, Kang / Zhao, Xiangmo / Wu, Xia | TIBKAT | 2020


    Prediction of Highway Lane Changes Based on Prototype Trajectories

    Augustin, D. / Hofmann, M. / Konigorski, U. | British Library Conference Proceedings | 2019