Provided are methods for enhanced semantic labeling in mapping with a semantic labeling system, which can include receiving, from a LiDAR sensor of a vehicle, LiDAR point cloud information including at least one raw point feature for a point, receiving, from a camera of the vehicle, image data associated with an image captured using the camera, generating at least one rich point feature for the point based on the image data, predicting, using a LiDAR segmentation neural network and based on the at least one raw point feature and the at least one rich point feature, a point-level semantic label for the point, and providing the point-level semantic label to a mapping engine to generate a map based on the point-level semantic label Systems and computer program products are also provided.
Multi-modal segmentation network for enhanced semantic labeling in mapping
2025-05-07
Patent
Electronic Resource
English
IPC: | G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G01C Messen von Entfernungen, Höhen, Neigungen oder Richtungen , MEASURING DISTANCES, LEVELS OR BEARINGS / G01S RADIO DIRECTION-FINDING , Funkpeilung / G06V |
MULTI-MODAL SEGMENTATION NETWORK FOR ENHANCED SEMANTIC LABELING IN MAPPING
European Patent Office | 2023
|MULTI-MODAL SEGMENTATION NETWORK FOR ENHANCED SEMANTIC LABELING IN MAPPING
European Patent Office | 2023
|MULTI-MODAL SEGMENTATION NETWORK FOR ENHANCED SEMANTIC LABELING IN MAPPING
European Patent Office | 2023