Self-driving vehicles rely on multimodal motion forecasts to effectively interact with their environment and plan safe maneuvers. We introduce SceneMotion, an attention-based model for forecasting scene-wide motion modes of multiple traffic agents. Our model transforms local agent-centric em-beddings into scene-wide forecasts using a novel latent context module. This module learns a scene-wide latent space from multiple agent-centric embeddings, enabling joint forecasting and interaction modeling. The competitive performance in the Waymo Open Interaction Prediction Challenge demonstrates the effectiveness of our approach. Moreover, we cluster future waypoints in time and space to quantify the interaction be-tween agents. We merge all modes and analyze each mode independently to determine which clusters are resolved through interaction or result in conflict. Our implementation is available at: https://github.com/kit-mrt/future-motion


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts




    Publication date :

    2024-09-24


    Size :

    2520577 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    BEHAVIOR PREDICTION USING SCENE-CENTRIC REPRESENTATIONS

    DOUILLARD BERTRAND ROBERT / ZHOU AURICK QIKUN / AL-RFOU RAMI et al. | European Patent Office | 2025

    Free access


    Scene-Centric Identification and Retrieval of Unmanned Aerial Vehicle (UAV) Video Segments

    Berridge, W. T. / IEEE | British Library Conference Proceedings | 2000


    Roadmap towards an ECAC-wide Flight Centric ATC implementation

    Kluenker, Carmo S. / Finck, Tobias | IEEE | 2023


    Forecasts

    Online Contents | 1996