Techniques are provided for improving a perception processing pipeline for object detection that fuses image segmentation data (e.g., segmentation scores) with LiDAR points. The disclosed techniques are implemented using an architecture that accepts point clouds and images as input and estimates oriented 3D bounding boxes for all relevant object classes. In an embodiment, a method comprises: matching temporally, using one or more processors of a vehicle, points in a three-dimensional (3D) point cloud with an image; generating, using an image-based neural network, semantic data for the image; decorating, using the one or more processors, the points in the 3D point cloud with the semantic data; and estimating, using a 3D object detector with the decorated points as input, oriented 3D bounding boxes for the one or more objects.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Sequential fusion for 3D object detection


    Beteiligte:
    VORA SOURABH (Autor:in) / BEIJBOM OSCAR OLOF (Autor:in) / LANG ALEX HUNTER (Autor:in) / HELOU BASSAM (Autor:in)

    Erscheinungsdatum :

    2023-04-25


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL



    SEQUENTIAL FUSION FOR 3D OBJECT DETECTION

    VORA SOURABH / BEIJBOM OSCAR OLOF / LANG ALEX HUNTER et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    SEQUENTIAL FUSION FOR 3D OBJECT DETECTION

    VORA SOURABH / BEIJBOM OSCAR OLOF / LANG ALEX HUNTER et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Sequential fusion for 3D object detection

    VORA SOURABH / BEIJBOM OSCAR OLOF / LANG ALEX HUNTER et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Multimodel Fusion Based Sequential Optimization

    Chen, Shishi | Online Contents | 2017


    Multimodel Fusion Based Sequential Optimization

    Chen, Shishi / Jiang, Zhen / Yang, Shuxing et al. | AIAA | 2016