Techniques for determining predictions on a top-down representation of an environment based on vehicle action(s) are discussed herein. Sensors of a first vehicle (such as an autonomous vehicle) can capture sensor data of an environment, which may include object(s) separate from the first vehicle (e.g., a vehicle or a pedestrian). A multi-channel image representing a top-down view of the object(s) and the environment can be generated based on the sensor data, map data, and/or action data. Environmental data (object extents, velocities, lane positions, crosswalks, etc.) can be encoded in the image. Action data can represent a target lane, trajectory, etc. of the first vehicle. Multiple images can be generated representing the environment over time and input into a prediction system configured to output prediction probabilities associated with possible locations of the object(s) in the future, which may be based on the actions of the autonomous vehicle.


    Access

    Download


    Export, share and cite



    Title :

    PREDICTION ON TOP-DOWN SCENES BASED ON ACTION DATA


    Additional title:

    PRÄDIKTION AUF TOPDOWN-SZENEN AUF BASIS VON AKTIONSDATEN
    PRÉDICTION SUR DES SCÈNES DE HAUT EN BAS SUR LA BASE DE DONNÉES D'ACTION



    Publication date :

    2023-07-19


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Prediction on top-down scenes based on action data

    GARIMELLA GOWTHAM / KOBILAROV MARIN / MORALES MORALES ANDRES GUILLERMO et al. | European Patent Office | 2021

    Free access

    PREDICTION ON TOP-DOWN SCENES BASED ON ACTION DATA

    GARIMELLA GOWTHAM / KOBILAROV MARIN / MORALES MORALES ANDRES GUILLERMO et al. | European Patent Office | 2021

    Free access

    Prediction on top-down scenes based on action data

    GARIMELLA GOWTHAM / KOBILAROV MARIN / MORALES MORALES ANDRES GUILLERMO et al. | European Patent Office | 2023

    Free access

    PREDICTION ON TOP-DOWN SCENES BASED ON ACTION DATA

    GARIMELLA GOWTHAM / KOBILAROV MARIN / MORALES MORALES ANDRES GUILLERMO et al. | European Patent Office | 2021

    Free access

    PREDICTION ON TOP-DOWN SCENES BASED ON ACTION DATA

    GARIMELLA GOWTHAM / KOBILAROV MARIN / MORALES MORALES ANDRES GUILLERMO et al. | European Patent Office | 2021

    Free access