A method and system is provided for generating a perception scene graph (PSG) for use in a motor vehicle. External sensor information and vehicle-to-everything (V2X) information are collected on a volume of space surrounding the vehicle. The sensor information and V2X information are fused to increase the fidelity of the information. The fused information is analyzed to detect, classify, and locate objects present in the volume of space surrounding the vehicle. A perception controller generates and publishes the PSG, which includes a virtual 3-D model of the volume of space containing the classified and located objects. At least one vehicle controller subscribes to the PSG and extracts information from the PSG for use as an input for a software application to generate instructions for use in execution of a vehicle application routine. The vehicle controller may also publish a real time copy of the PSG.
METHOD AND SYSTEM FOR GENERATING AND USING A PERCEPTION SCENE GRAPH IN MOTOR VEHICLE APPLICATIONS
2018-11-29
Patent
Electronic Resource
English
IPC: | G06K Erkennen von Daten , RECOGNITION OF DATA / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS |
European Patent Office | 2018
|METHOD FOR GENERATING A WIDE-AREA PERCEPTION SCENE GRAPH
European Patent Office | 2018
|METHOD AND SYSTEM FOR GENERATING A WIDE-AREA PERCEPTION SCENE GRAPH
European Patent Office | 2018
|Scene-Graph Embedding for Robust Autonomous Vehicle Perception
Springer Verlag | 2023
|System for Generating Scene Context Data Using a Reference Graph
European Patent Office | 2024
|