A computer vision module facilitates multi-sensor vision of AVs based on privileged information learning. The module may input first sensor data captured by a first sensor into an already-trained privileged model, input second sensor data captured by a second sensor into a first backbone of a target model, and input third sensor data captured by a third sensor into a second backbone of the target model. The three sensors may be of different types. To train the target model, internal parameters of the target model may be modified to minimize a loss, which may include a privilege loss, which indicates a difference between a latent representation of the first sensor data and a latent representation of the second sensor data, and another privileged loss, which indicates a difference between the latent representation of the first sensor data and a latent representation of the third sensor data.
MULTI-SENSOR VISION FOR AUTONOMOUS VEHICLE BASED ON PRIVILEGED INFORMATION LEARNING
2025-02-27
Patent
Electronic Resource
English
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion |
MULTI-SENSOR VISION FOR AUTONOMOUS VEHICLE BASED ON PRIVILEGED INFORMATION LEARNIN
European Patent Office | 2025
|Vision-Based Deep Reinforcement Learning of UAV Autonomous Navigation Using Privileged Information
ArXiv | 2024
|Privileged Information in Mishap Investigation
Online Contents | 1994