To provide an emergency vehicle detection system that uses both audio data and visual data to detect existence of an emergency vehicle in the ambient environment of an ADV.SOLUTION: An emergency vehicle detection system uses a disciplined neural network to individually produce a result of detection from audio data. Another disciplined network is used to individually produces another result of detection from visual data. The emergency vehicle detection system converges the two results of detection so as to determine the position and moving direction of an emergency vehicle.SELECTED DRAWING: Figure 5

    【課題】一実施形態では、オーディオデータ及びビジュアルデータの両方を使用してADVの周囲環境における緊急車両の存在を検出する緊急車両検出システムを提供する。【解決手段】緊急車両検出システムは、訓練されたニューラルネットワークを使用してオーディオデータから検出結果を個別に生成し、別の訓練されたネットワークを使用してビジュアルデータから別の検出結果を個別に生成する。緊急車両検出システムは2つの検出結果を融合して、緊急車両の位置及び移動方向を決定する。【選択図】図5


    Access

    Download


    Export, share and cite



    Title :

    POST-MEDIA CONVERGENCE IN DETECTION OF AUDIO AND VISUAL OF EMERGENCY VEHICLE


    Additional title:

    緊急車両のオーディオ及びビジュアル検出のポスト融合


    Contributors:
    XU KECHENG (author) / SUN HONGYI (author) / LUO QI (author) / WANG WEI (author) / LIN ZEJUN (author) / WESLEY REYNOLDS (author) / LIU FENG (author) / HU JIANTAO (author) / MIAO JINGHAO (author)

    Publication date :

    2022-04-12


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Japanese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen



    EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2022

    Free access

    EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2022

    Free access

    Emergency vehicle audio and visual detection post fusion

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2025

    Free access

    EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION

    European Patent Office | 2023

    Free access

    EMERGENCY VEHICLE DETECTION FUSING AUDIO AND VISUAL DATA

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2022

    Free access