Systems and methods for sound source detection and localization utilizing an autonomous driving vehicle, ADV (101) are disclosed. The method includes receiving audio data from a number of audio sensors (411) mounted on the ADV (101). The audio data comprises sounds captured by the audio sensors (411) and emitted by one or more sound sources (509, 510). Based on the received audio data, the method further includes determining a number of sound source information. Each sound source information comprises a confidence score associated with an existence of a specific sound. The method further includes generating a data representation to report whether there exists the specific sound within the driving environment of the ADV (101). The data representation comprises the determined sound source information. The received audio data and the generated data representation are utilized to subsequently train a machine learning algorithm (122) to recognize the specific sound source during autonomous driving of the ADV (101) in real-time.
SOUND SOURCE DETECTION AND LOCALIZATION FOR AUTONOMOUS DRIVING VEHICLE
SCHALLQUELLENDETEKTION UND -LOKALISIERUNG FÜR EIN AUTONOMES FAHRENDES FAHRZEUG
DÉTECTION ET LOCALISATION DE SOURCE SONORE POUR UN VÉHICULE À CONDUITE AUTONOME
2022-07-13
Patent
Electronic Resource
English
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G01S RADIO DIRECTION-FINDING , Funkpeilung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS / H04R LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS , Lautsprecher, Mikrofone, Schallplatten-Tonabnehmer oder ähnliche akustische, elektromechanische Wandler |
SOUND SOURCE DETECTION AND LOCALIZATION FOR AUTONOMOUS DRIVING VEHICLE
European Patent Office | 2023
SOUND SOURCE DETECTION AND LOCALIZATION FOR AUTONOMOUS DRIVING VEHICLE
European Patent Office | 2022
|DETECTION AND POSITION IDENTIFICATION OF SOUND SOURCE FOR AUTONOMOUS VEHICLE
European Patent Office | 2022
|