Pedestrian trajectory prediction in crowd scenes plays a significant role in intelligent transportation systems. The main challenges are manifested in learning motion patterns and addressing future uncertainty. Typically, trajectory prediction is considered in two dimensions, including temporal dynamics modeling and social interactions capturing. For temporal dependencies, although existing models based on recurrent neural networks (RNNs) or convolutional neural networks (CNNs) achieve high performance on short-term prediction, they still suffer from limited scalability for long sequences. For social interactions, previous graph-based methods only consider fixed features but ignore dynamic interactions between pedestrians. Considering that the transformer network has a strong capability of capturing spatial and long-term temporal dynamics, we propose Long-Short Term Spatio-Temporal Aggregation (LSSTA) network for human trajectory prediction. First, a modern variant of graph neural networks, named spatial encoder, is presented to characterize spatial interactions between pedestrians. Second, LSSTA utilizes a transformer network to handle long-term temporal dependencies and aggregates the spatial and temporal features with a temporal convolution network (TCN). Thus, TCN is combined with the transformer to form a long-short term temporal dependency encoder. Additionally, multi-modal prediction is an efficient way to address future uncertainty. Existing auto-encoder modules are extended with static scene information and future ground truth for multi-modal trajectory prediction. Experimental results on complex scenes demonstrate the superior performance of our method in comparison to existing approaches.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Long-Short Term Spatio-Temporal Aggregation for Trajectory Prediction


    Contributors:
    Yang, Cuiliu (author) / Pei, Zhao (author)


    Publication date :

    2023-04-01


    Size :

    1985468 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Vessel trajectory prediction with a Gated Spatio-Temporal Graph Aggregation Network

    Zhang, Xiliang / Liu, Jin / Gong, Peizhu et al. | IEEE | 2023


    PreTR: Spatio-Temporal Non-Autoregressive Trajectory Prediction Transformer

    Achaji, Lina / Barry, Thierno / Fouqueray, Thibault et al. | IEEE | 2022


    Group Vehicle Trajectory Prediction With Global Spatio-Temporal Graph

    Xu, Dongwei / Shang, Xuetian / Liu, Yewanze et al. | IEEE | 2023


    Short-term traffic flow prediction method based on spatio-temporal correlation

    QI YONG / XIONG TING / ZHANG WEIBIN et al. | European Patent Office | 2020

    Free access

    A Unified Spatio-Temporal Model for Short-Term Traffic Flow Prediction

    Duan, Peibo / Mao, Guoqiang / Liang, Weifa et al. | IEEE | 2019