Methods, systems, and apparatus for predicting future trajectories of agents in an environment. In one aspect, a system comprises one or more computers configured to receive sensor data of an environment having one or more agents. The system decomposes the sensor data into a plurality of scene elements in the environment, and the system generates multiple tokens including a respective token for each respective scene element of the multiple scene elements in the environment. The system processes the multiple tokens using a decoder model to generate a respective predicted trajectory for the one or more agents in the environment.


    Access

    Download


    Export, share and cite



    Title :

    SCENE TOKENIZATION FOR MOTION PREDICTION


    Contributors:
    ZHOU YIN (author) / JI JINGWEI (author) / YANG ZHENPEI (author) / HARADA NATHAN PAUL (author) / CHEN KAN (author) / AL-RFOU RAMI (author)

    Publication date :

    2025-05-22


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06V / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    TOKENIZATION FOR ON-DEMAND TRAFFIC RESOURCE ALLOCATION

    CLIFFORD DAVID HAHN / MORGAN ROBERT MICHAEL / DUBLA PIOTR BARTLOMIEJ | European Patent Office | 2024

    Free access

    Top-down scene prediction based on motion data

    GARIMELLA GIANNI / KOBILAROV MARIN / MORALES MORALES ANGEL GUADALUPE et al. | European Patent Office | 2022

    Free access

    Top-down scene prediction based on object motion

    MORALES MORALES ANGEL GUADALUPE / KOBILAROV MARIN / GARIMELLA GIANNI et al. | European Patent Office | 2022

    Free access

    Relation-based Motion Prediction using Traffic Scene Graphs

    Zipfl, Maximilian / Hertlein, Felix / Rettinger, Achim et al. | IEEE | 2022


    DANGEROUS SCENE PREDICTION DEVICE, DANGEROUS SCENE PREDICTION METHOD, AND DANGEROUS SCENE PREDICTION PROGRAM

    FUTATSUGI YASUNORI / MISHIMA YOSHIHIRO / FUKUZATO ATSUSHI et al. | European Patent Office | 2020

    Free access