According to various embodiments, systems, methods, and mediums for operating an autonomous driving vehicles (ADV) are described. The embodiments use a number of machine learning models to extract features individually from audio data and visual data captured by sensors mounted on the ADV, and then to fuse these extracted features to create a concatenated feature vectors. The concatenated feature vector is provided to a multiplayer perceptron (MLP) as input to generate a detection result related to the presence of an emergency vehicle in the surrounding environment. The detection result can be used by the ADV to take appropriate actions to comply with the local traffic rules.
Machine learning model to fuse emergency vehicle audio and visual detection
2023-04-04
Patent
Elektronische Ressource
Englisch
MACHINE LEARNING MODEL TO FUSE EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION
Europäisches Patentamt | 2022
|MACHINE LEARNING MODEL TO FUSE EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION
Europäisches Patentamt | 2022
|EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION
Europäisches Patentamt | 2022
|EMERGENCY VEHICLE DETECTION FUSING AUDIO AND VISUAL DATA
Europäisches Patentamt | 2022
|EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION
Europäisches Patentamt | 2022
|