In various examples, a sequential deep neural network (DNN) may be trained using ground truth data generated by correlating (e.g., by cross-sensor fusion) sensor data with image data representative of a sequences of images. In deployment, the sequential DNN may leverage the sensor correlation to compute various predictions using image data alone. The predictions may include velocities, in world space, of objects in fields of view of an ego-vehicle, current and future locations of the objects in image space, and/or a time-to-collision (TTC) between the objects and the ego-vehicle. These predictions may be used as part of a perception system for understanding and reacting to a current physical environment of the ego-vehicle.


    Access

    Download


    Export, share and cite



    Title :

    TEMPORAL INFORMATION PREDICTION IN AUTONOMOUS MACHINE APPLICATIONS


    Contributors:
    WU YUE (author) / JANIS PEKKA (author) / TONG XIN (author) / YANG CHENG-CHIEH (author) / PARK MINWOO (author) / NISTER DAVID (author)

    Publication date :

    2024-02-22


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G06V



    Temporal information prediction in autonomous machine applications

    WU YUE / JANIS PEKKA / TONG XIN et al. | European Patent Office | 2023

    Free access

    Temporal information prediction in autonomous machine applications

    WU YUE / JANIS PEKKA / TONG XIN et al. | European Patent Office | 2020

    Free access

    Future trajectory prediction in multi-actor environment for autonomous machine applications

    KAMENEV ANDREY / SMOLYANSKIY NIKOLAI / KULKARNI IMRAN et al. | European Patent Office | 2022

    Free access


    Trajectory prediction for autonomous driving based on multiscale spatial‐temporal graph

    Tang, Luqi / Yan, Fuwu / Zou, Bin et al. | Wiley | 2023

    Free access