The uncertainty of a driver’s state, the variability of the traffic environment, and the complexity of road conditions have made driving behavior a critical factor affecting traffic safety. Accurate predicting of driving behavior is therefore crucial for ensuring safe driving. In this research, an efficient framework, distilled routing transformer (DRTR), is proposed for driving behavior prediction using multiple modality data, i.e., front view video frames and vehicle signals. First, a cross-modal attention distiller is introduced, which distills the cross-modal attention knowledge of a fusion-encoder transformer to guide the training of our DRTR and learn deep interactions between different modalities. Second, since the multi-modal learning usually requires information from the macro view to the micro view, a self-attention (SA)-routing module is custom-designed for SA layers in DRTR for dynamic scheduling of global and local attentions for each input instance. Finally, a Mogrifier long short-term memory (Mogrifier LSTM) network is employed for DRTR to predict driving behaviors. We applied our approach to real-world data collected during drives in both urban and freeway environments by an instrumented vehicle. The experimental results demonstrate that the DRTR can predict the imminent driving behavior effectively while enjoying a faster inference speed than other state-of-the-art (SOTA) baselines.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Distilled Routing Transformer for Driving Behavior Prediction


    Additional title:

    Sae Int. J. Trans. Safety


    Contributors:
    Yi, Jiangang (author) / Gao, Jun (author) / Murphey, Yi Lu (author)


    Publication date :

    2023-10-10




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Self-distilled Vision Transformer for Domain Generalization

    Sultana, Maryam / Naseer, Muzammal / Khan, Muhammad Haris et al. | British Library Conference Proceedings | 2023


    Automatic driving vehicle behavior prediction method and system fusing complex network and graph Transformer

    LIU QINGCHAO / WANG LINQIANG / ZHAO JINGYA et al. | European Patent Office | 2023

    Free access


    Auxiliary driving control method based on driving behavior prediction

    WANG JINXIANG / FANG ZHENWU / LIU NENG et al. | European Patent Office | 2022

    Free access

    PREDICTION OF A LIKELY DRIVING BEHAVIOR

    PAULS JAN-HENDRIK / STRAUSS TOBIAS | European Patent Office | 2021

    Free access