Accurate trajectory prediction for neighboring agents is crucial for autonomous vehicles navigating complex scenes. Recent deep learning (DL) methods excel in encoding complex interactions but often generate invalid predictions due to difficulties in modeling transient and contingency interactions. This paper proposes a hierarchical hybrid framework that combines DL and reinforcement learning (RL) for multi-agent trajectory prediction, capturing multi-scale interactions that shape future motion. In the DL stage, Transformer-style graph neural network (GNN) is employed to encode heterogeneous interactions at intermediate and global scales, predicting multi-modal intentions as key future positions for agents. In the RL stage, we divide the scene into local scenes based on DL predictions. A Transformer-based Proximal Policy Optimization (PPO) model, incorporated with vehicle kinematics, generates future trajectories in the form of motion planning shaped by microscopic interactions and guided by a multi-objective reward for balanced agent-centric accuracy and scene-wise compatibility. Experimental results on the Argoverse benchmark and driver-in-loop simulations demonstrate that our framework enhances trajectory prediction feasibility and plausibility in interactive scenes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Hierarchical Hybrid Learning Framework for Multi-Agent Trajectory Prediction


    Contributors:
    Jiao, Yujun (author) / Miao, Mingze (author) / Yin, Zhishuai (author) / Lei, Chunyuan (author) / Zhu, Xu (author) / Zhao, Xiaobin (author) / Nie, Linzhen (author) / Tao, Bo (author)


    Publication date :

    2024-08-01


    Size :

    2878501 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    HSTR: Hierarchical Scene Transformer for Multi-agent Trajectory Prediction*

    Fu, Shuaiqi / Yang, Yixuan / Luo, Xiaoyang et al. | IEEE | 2024


    Multi-agent trajectory prediction

    NARAYANAN SRIRAM NOCHUR / LIU BUYU / MOSLEMI RAMIN et al. | European Patent Office | 2023

    Free access

    MULTI-AGENT TRAJECTORY PREDICTION

    NARAYANAN SRIRAM NOCHUR / LIU BUYU / MOSLEMI RAMIN et al. | European Patent Office | 2021

    Free access

    Multi-modal multi-agent trajectory prediction

    SUN PEI / ZHAO HANG / MCCAULEY ALEXANDER et al. | European Patent Office | 2024

    Free access

    MULTI-MODAL MULTI-AGENT TRAJECTORY PREDICTION

    SUN PEI / ZHAO HANG / MCCAULEY ALEXANDER et al. | European Patent Office | 2022

    Free access