Aspects of the disclosure relate to training and using a model for identifying actions of objects. For instance, LIDAR sensor data frames including an object bounding box corresponding to an object as well as an action label for the bounding box may be received. Each sensor frame is associated with a timestamp and is sequenced with respect to other sensor frames. Each given sensor data frame may be projected into a camera image of the object based on the timestamp associated with the given sensor data frame in order to provide fused data. The model may be trained using the fused data such that the model is configured to, in response to receiving fused data, the model outputs an action label for each object bounding box of the fused data. This output may then be used to control a vehicle in an autonomous driving mode.


    Access

    Download


    Export, share and cite



    Title :

    Object action classification for autonomous vehicles


    Contributors:
    MAO JUNHUA (author) / LI CONGCONG (author) / AYVACI ALPER (author) / SUN CHEN (author) / MURPHY KEVIN (author) / YU RUICHI (author)

    Publication date :

    2021-07-13


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G01S RADIO DIRECTION-FINDING , Funkpeilung / G06K Erkennen von Daten , RECOGNITION OF DATA



    Object Action Classification For Autonomous Vehicles

    MAO JUNHUA / LI CONGCONG / AYVACI ALPER et al. | European Patent Office | 2020

    Free access

    Object Action Classification For Autonomous Vehicles

    MAO JUNHUA / LI CONGCONG / AYVACI ALPER et al. | European Patent Office | 2021

    Free access

    SYSTEMS AND METHODS FOR OBJECT CLASSIFICATION IN AUTONOMOUS VEHICLES

    RYAN LAWRENCE OLIVER | European Patent Office | 2019

    Free access

    Systems and methods for object classification in autonomous vehicles

    RYAN LAWRENCE OLIVER | European Patent Office | 2019

    Free access

    Remote object detection, localization, tracking and classification for autonomous vehicles

    YU RENJUN / LEE KEVIN / HAN TAEYOUNG et al. | European Patent Office | 2022

    Free access