Predicting future motions of nearby agents is essential for an autonomous vehicle to take safe and effective actions. In this paper, we propose TSGN, a framework using Temporal Scene Graph Neural Networks with projected vectorized representations for multi-agent trajectory prediction. Projected vectorized representation models the traffic scene as a graph which is constructed by a set of vectors. These vectors represent agents, road network, and their spatial relative relationships. All relative features under this representation are both translation-and rotation-invariant. Based on this representation, TSGN captures the spatial-temporal features across agents, road network, interactions among them, and temporal dependencies of temporal traffic scenes. TSGN can predict multimodal future trajectories for all agents simultaneously, plausibly, and accurately. Mean-while, we propose a Hierarchical Lane Transformer for capturing interactions between agents and road network, which filters the surrounding road network and only keeps the most probable lane segments which could have an impact on the future behavior of the target agent. Without sacrificing the prediction performance, this greatly reduces the computational burden. Experiments show TSGN achieves state-of-the-art performance on the Argoverse motion forecasting benchmark.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    TSGN: Temporal Scene Graph Neural Networks with Projected Vectorized Representation for Multi-Agent Motion Prediction


    Contributors:


    Publication date :

    2023-06-04


    Size :

    2342024 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    AGENT TRAJECTORY PREDICTION USING VECTORIZED INPUTS

    GAO JIYANG / SHEN YI / ZHAO HANG et al. | European Patent Office | 2023

    Free access

    AGENT TRAJECTORY PREDICTION USING VECTORIZED INPUTS

    GAO JIYANG / SHEN YI / ZHAO HANG et al. | European Patent Office | 2021

    Free access

    GRAPH NEURAL NETWORKS WITH VECTORIZED OBJECT REPRESENTATIONS IN AUTONOMOUS VEHICLE SYSTEMS

    GARIMELLA GOWTHAM / MORALES MORALES ANDRES GUILLERMO | European Patent Office | 2022

    Free access

    AGENT TRAJECTORY PREDICTION USING VECTORIZED INPUTS

    GAO JIYANG / SHEN YI / ZHAO HANG et al. | European Patent Office | 2021

    Free access

    Intelligent agent trajectory prediction using vectorized input

    GAO JIYANG / SHEN YI / ZHAO HONG et al. | European Patent Office | 2022

    Free access