The uncertainty of a driver’s state, the variability of the traffic environment, and the complexity of road conditions have made driving behavior a critical factor affecting traffic safety. Accurate predicting of driving behavior is therefore crucial for ensuring safe driving. In this research, an efficient framework, distilled routing transformer (DRTR), is proposed for driving behavior prediction using multiple modality data, i.e., front view video frames and vehicle signals. First, a cross-modal attention distiller is introduced, which distills the cross-modal attention knowledge of a fusion-encoder transformer to guide the training of our DRTR and learn deep interactions between different modalities. Second, since the multi-modal learning usually requires information from the macro view to the micro view, a self-attention (SA)-routing module is custom-designed for SA layers in DRTR for dynamic scheduling of global and local attentions for each input instance. Finally, a Mogrifier long short-term memory (Mogrifier LSTM) network is employed for DRTR to predict driving behaviors. We applied our approach to real-world data collected during drives in both urban and freeway environments by an instrumented vehicle. The experimental results demonstrate that the DRTR can predict the imminent driving behavior effectively while enjoying a faster inference speed than other state-of-the-art (SOTA) baselines.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Distilled Routing Transformer for Driving Behavior Prediction


    Weitere Titelangaben:

    Sae Int. J. Trans. Safety


    Beteiligte:
    Yi, Jiangang (Autor:in) / Gao, Jun (Autor:in) / Murphey, Yi Lu (Autor:in)


    Erscheinungsdatum :

    2023-10-10




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    Self-distilled Vision Transformer for Domain Generalization

    Sultana, Maryam / Naseer, Muzammal / Khan, Muhammad Haris et al. | British Library Conference Proceedings | 2023


    Automatic driving vehicle behavior prediction method and system fusing complex network and graph Transformer

    LIU QINGCHAO / WANG LINQIANG / ZHAO JINGYA et al. | Europäisches Patentamt | 2023

    Freier Zugriff


    Auxiliary driving control method based on driving behavior prediction

    WANG JINXIANG / FANG ZHENWU / LIU NENG et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Driving Behavior Prediction Considering Cognitive Prior and Driving Context

    Zhou, Dong / Liu, Hongyi / Ma, Huimin et al. | IEEE | 2021