Forecasting pedestrian trajectories in complex dynamic environments is highly critical for the application of autonomous vehicles and robots. Accordingly, this paper proposes a novel pedestrian trajectory prediction model called CTSGI, which, utilizes self-attention mechanism to construct an interactive graph between pedestrians and their neighbors based on their spatial relationship, to model the crowd’s interaction. At the same time, it uses self-attention to extract the temporal dependence for a single pedestrian. In order to effectively model the interaction between the pedestrian and the context, such as where a pedestrian can walk or approach, the semantic segmentation of background image is utilized. CTSGI estimates the goal points of pedestrian and their neighbors to assist in predicting the future trajectory. In addition, the causal structure model is used to analyze the confounding factors existing in the encoding stage, and Do-calculus is introduced for eliminating the confounding impact to improve the prediction performance. Moreover, extensive experiments are conducted for the proposed model on ETH and UCY datasets, and clearly, the experimental results reveal that the model reported herein outperforms the comparative state-of-the-art methods by 27.59% in Average Displacement Error (ADE) and 8.33% in Final Displacement Error (FDE). Furthermore, visualization of attention indicates that our model can capture the interaction between some specific pedestrian and their neighbors better.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Causal Temporal–Spatial Pedestrian Trajectory Prediction With Goal Point Estimation and Contextual Interaction


    Contributors:
    Lian, Jing (author) / Yu, Fengning (author) / Li, Linhui (author) / Zhou, Yafu (author)

    Published in:

    Publication date :

    2022-12-01


    Size :

    3350974 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Spatial-Temporal-Spectral LSTM: A Transferable Model for Pedestrian Trajectory Prediction

    Zhang, Chi / Ni, Zhongjun / Berger, Christian | IEEE | 2024

    Free access

    Goal-Oriented Pedestrian Motion Prediction

    Wu, Jingyuan / Ruenz, Johannes / Berkemeyer, Hendrik et al. | IEEE | 2024


    Pedestrian trajectory prediction system and method considering interaction

    ZHOU XIAOCHUAN / ZHAO WANZHONG / WANG CHUNYAN et al. | European Patent Office | 2023

    Free access

    Pedestrian trajectory prediction method and device

    ZHENG WEN / LIU CHUANG / XU GUANGYU et al. | European Patent Office | 2023

    Free access