Driver attention prediction is becoming an essential research problem in human-like driving systems. This work makes an attempt to predict the driver attention in driving accident scenarios (DADA). However, challenges tread on the heels of that because of the dynamic traffic scene, intricate and imbalanced accident categories. In this work, we design a semantic context induced attentive fusion network (SCAFNet). We first segment the RGB video frames into the images with different semantic regions (i.e., semantic images), where each region denotes one semantic category of the scene (e.g., road, trees, etc.), and learn the spatio-temporal features of RGB frames and semantic images in two parallel paths simultaneously. Then, the learned features are fused by an attentive fusion network to find the semantic-induced scene variation in driver attention prediction. The contributions are three folds. 1) With the semantic images, we introduce their semantic context features and verify the manifest promotion effect for helping the driver attention prediction, where the semantic context features are modeled by a graph convolution network (GCN) on semantic images; 2) We fuse the semantic context features of semantic images and the features of RGB frames in an attentive strategy, and the fused details are transferred over frames by a convolutional LSTM module to obtain the attention map of each video frame with the consideration of historical scene variation in driving situations; 3) The superiority of the proposed method is evaluated on our previously collected dataset (named as DADA-2000) and two other challenging datasets with state-of-the-art methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    DADA: Driver Attention Prediction in Driving Accident Scenarios


    Beteiligte:
    Fang, Jianwu (Autor:in) / Yan, Dingxin (Autor:in) / Qiao, Jiahuan (Autor:in) / Xue, Jianru (Autor:in) / Yu, Hongkai (Autor:in)


    Erscheinungsdatum :

    01.06.2022


    Format / Umfang :

    3304992 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    DADA-2000: Can Driving Accident be Predicted by Driver Attentionƒ Analyzed by A Benchmark

    Fang, Jianwu / Yan, Dingxin / Qiao, Jiahuan et al. | IEEE | 2019


    Traffic Accident Anticipation via Driver Attention Auxiliary

    Li, Lei-Lei / Fang, Jianwu | Springer Verlag | 2024


    Driving Experience and Simulation of Accident Scenarios

    Berthelon, C. / Nachtergaele, C. / Aillerie, I. | British Library Conference Proceedings | 2008


    Simulation of accident scenarios and driving experience

    Berthelon, Catherine | Online Contents | 2007


    Multisource Adaption for Driver Attention Prediction in Arbitrary Driving Scenes

    Gan, Shun / Pei, Xizhe / Ge, Yulong et al. | IEEE | 2022