Pedestrian intent prediction is critical for autonomous driving, as accurately predicting crossing intentions helps prevent collisions and ensures the safety of both pedestrians and passengers. Recent research has focused on vision-based deep neural networks for this task, but challenges remain. First, current methods suffer from low efficiency in multi-feature fusion and unreliable predictions under challenging conditions. Additionally, real-time performance is essential in practical applications, so the efficiency of the algorithm is crucial. To address these issues, we propose a novel architecture, Dual-STGAT, which uses a dual-level spatio-temporal graph network to extract pedestrian pose and scene interaction features, reducing information loss and improving feature fusion efficiency. The model captures key features of pedestrian behavior and the surrounding environment through two modules: the Pedestrian Module and the Scene Module. The Pedestrian Module extracts pedestrian motion features using a spatio-temporal graph attention network, while the Scene Module models interactions between pedestrians and surrounding objects by integrating visual, semantic, and motion information through a graph network. Extensive experiments conducted on the PIE and JAAD datasets show that Dual-STGAT achieves over 90% accuracy in pedestrian crossing intention prediction, with inference latency close to 5ms, making it well-suited for large-scale production autonomous driving systems that demand both performance and computational efficiency.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Dual-STGAT: Dual Spatio-Temporal Graph Attention Networks With Feature Fusion for Pedestrian Crossing Intention Prediction


    Beteiligte:
    Lian, Jing (Autor:in) / Luo, Yiyang (Autor:in) / Wang, Xuecheng (Autor:in) / Li, Linhui (Autor:in) / Guo, Ge (Autor:in) / Ren, Weiwei (Autor:in) / Zhang, Tao (Autor:in)


    Erscheinungsdatum :

    01.04.2025


    Format / Umfang :

    4040055 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Predicting Pedestrian Crossing Intention With Feature Fusion and Spatio-Temporal Attention

    Yang, Dongfang / Zhang, Haolin / Yurtsever, Ekim et al. | IEEE | 2022


    Multi-attention network for pedestrian intention prediction based on spatio-temporal feature fusion

    Zhang, Xiaofei / Wang, Xiaolan / Zhang, Weiwei et al. | SAGE Publications | 2024




    Scene Spatio-Temporal Graph Convolutional Network for Pedestrian Intention Estimation

    Naik, Abhilash Y. / Bighashdel, Ariyan / Jancura, Pavol et al. | IEEE | 2022