In one embodiment, an emergency vehicle detection system can be provided in the ADV travelling on a road to detect the presence of an emergency vehicle in a surrounding environment of the ADV using both audio data and visual data. The emergency vehicle detection system can use a trained neutral network to independently generate a detection result from the audio data, and use another trained network to independently generate another detection result from the visual data. The emergency vehicle detection system can fuse the two detection results to determine the position and moving direction of the emergency vehicle. The ADV can take appropriate actions in response to the position and moving direction of the emergency vehicle.


    Access

    Download


    Export, share and cite



    Title :

    EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION


    Contributors:
    XU KECHENG (author) / SUN HONGYI (author) / LUO QI (author) / WANG WEI (author) / LIN ZEJUN (author) / REYNOLDS WESLEY (author) / LIU FENG (author) / HU JIANGTAO (author) / MIAO JINGHAO (author)

    Publication date :

    2022-07-14


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G05B Steuer- oder Regelsysteme allgemein , CONTROL OR REGULATING SYSTEMS IN GENERAL / G06K Erkennen von Daten , RECOGNITION OF DATA / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen / H04R LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS , Lautsprecher, Mikrofone, Schallplatten-Tonabnehmer oder ähnliche akustische, elektromechanische Wandler



    EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION

    European Patent Office | 2023

    Free access

    EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2022

    Free access

    POST-MEDIA CONVERGENCE IN DETECTION OF AUDIO AND VISUAL OF EMERGENCY VEHICLE

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2022

    Free access

    EMERGENCY VEHICLE DETECTION FUSING AUDIO AND VISUAL DATA

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2022

    Free access

    Emergency vehicle audio detection

    LUO QI / XU KECHENG / ZHOU JINYUN et al. | European Patent Office | 2023

    Free access