The advancement of socially-aware autonomous vehicles hinges on precise modeling of human behavior. Within this broad paradigm, the specific challenge lies in accurately predicting pedestrian's trajectory and intention. Traditional methodologies have leaned heavily on historical trajectory data, frequently overlooking vital contextual cues such as pedestrian-specific traits and environmental factors. Furthermore, there's a notable knowledge gap as trajectory and intention prediction have largely been approached as separate problems, despite their mutual dependence. To bridge this gap, we introduce PTINet (Pedestrian Trajectory and Intention Prediction Network), which jointly learns the trajectory and intention prediction by combining past trajectory observations, local contextual features (individual pedestrian behaviors), and global features (signs, markings etc.). The efficacy of our approach is evaluated on widely used public datasets: JAAD and PIE, where it has demonstrated superior performance over existing state-of-the-art models in trajectory and intention prediction. The results from our experiments and ablation studies robustly validate PTINet's effectiveness in jointly exploring intention and trajectory prediction for pedestrian behaviour modelling. The experimental evaluation indicates the advantage of using global and local contextual features for pedestrian trajectory and intention prediction. The effectiveness of PTINet in predicting pedestrian behavior paves the way for the development of automated systems capable of seamlessly interacting with pedestrians in urban settings.


    Access

    Download


    Export, share and cite



    Title :

    Context-aware Multi-task Learning for Pedestrian Intent and Trajectory Prediction


    Contributors:

    Publication date :

    2024


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    A context-aware pedestrian trajectory prediction framework for automated vehicles

    Kalatian, Arash / Farooq, Bilal | ArXiv | 2021

    Free access

    Knowledge-aware Graph Transformer for Pedestrian Trajectory Prediction

    Liu, Yu / Zhang, Yuexin / Li, Kunming et al. | IEEE | 2023


    PEDESTRIAN INTENT YIELDING

    MNEIMNEH MAHER / DORSEY ANNE HOBBS / YAN QIAOJING | European Patent Office | 2023

    Free access

    Pedestrian Crossing Intent Prediction Using Vision Transformers

    Elgazwy, Ahmed / Elmoghazy, Somayya / Elgazzar, Khalid et al. | IEEE | 2024


    PEDESTRIAN INTENT YIELDING

    MNEIMNEH MAHER / DORSEY ANNE HOBBS / YAN QIAOJING | European Patent Office | 2023

    Free access