Systems and methods for sound source detection and localization utilizing an autonomous driving vehicle, ADV (101) are disclosed. The method includes receiving audio data from a number of audio sensors (411) mounted on the ADV (101). The audio data comprises sounds captured by the audio sensors (411) and emitted by one or more sound sources (509, 510). Based on the received audio data, the method further includes determining a number of sound source information. Each sound source information comprises a confidence score associated with an existence of a specific sound. The method further includes generating a data representation to report whether there exists the specific sound within the driving environment of the ADV (101). The data representation comprises the determined sound source information. The received audio data and the generated data representation are utilized to subsequently train a machine learning algorithm (122) to recognize the specific sound source during autonomous driving of the ADV (101) in real-time.


    Access

    Download


    Export, share and cite



    Title :

    SOUND SOURCE DETECTION AND LOCALIZATION FOR AUTONOMOUS DRIVING VEHICLE


    Additional title:

    SCHALLQUELLENDETEKTION UND -LOKALISIERUNG FÜR EIN AUTONOMES FAHRENDES FAHRZEUG
    DÉTECTION ET LOCALISATION DE SOURCE SONORE POUR UN VÉHICULE À CONDUITE AUTONOME


    Contributors:
    SUN HONGYI (author) / XU KECHENG (author) / LUO QI (author) / LIN ZEJUN (author) / WANG WEI (author) / REYNOLDS WESLEY (author) / HU JIANGTAO (author) / MIAO JINGHAO (author)

    Publication date :

    2022-07-13


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G01S RADIO DIRECTION-FINDING , Funkpeilung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS / H04R LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS , Lautsprecher, Mikrofone, Schallplatten-Tonabnehmer oder ähnliche akustische, elektromechanische Wandler




    SOUND SOURCE DETECTION AND LOCALIZATION FOR AUTONOMOUS DRIVING VEHICLE

    SUN HONGYI / XU KECHENG / LUO QI et al. | European Patent Office | 2022

    Free access

    Sound source for autonomous underwater vehicle

    MOROZOV ANDREY K / JONES CLAYTON P | European Patent Office | 2021

    Free access

    DETECTION AND POSITION IDENTIFICATION OF SOUND SOURCE FOR AUTONOMOUS VEHICLE

    SUN HONGYI / XU KECHENG / LUO QI et al. | European Patent Office | 2022

    Free access

    AUTONOMOUS DRIVING VEHICLE PARKING DETECTION

    GRAEFE RALF / ROSALES RAFAEL | European Patent Office | 2021

    Free access