According to various embodiments, systems, methods, and mediums for operating an autonomous driving vehicles (ADV) are described. The embodiments use a number of machine learning models to extract features individually from audio data and visual data captured by sensors mounted on the ADV, and then to fuse these extracted features to create a concatenated feature vectors. The concatenated feature vector is provided to a multiplayer perceptron (MLP) as input to generate a detection result related to the presence of an emergency vehicle in the surrounding environment. The detection result can be used by the ADV to take appropriate actions to comply with the local traffic rules.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    MACHINE LEARNING MODEL TO DETECT EMERGENCY VEHICLES FUSING AUDIO AND VISUAL SIGNALS


    Weitere Titelangaben:

    MASCHINELLES LERNEN MODELL ZUR ERKENNUNG VON EINSATZFAHRZEUGEN DURCH VERBINDUNG VON AUDIO- UND VISUELLEN SIGNALEN
    MODÈLE D'APPRENTISSAGE MACHINE POUR DÉTECTER LES VÉHICULES D'URGENCE EN FUSIONNANT DES SIGNAUX AUDIO ET VISUELS


    Beteiligte:
    XU KECHENG (Autor:in) / SUN HONGYI (Autor:in) / LUO QI (Autor:in) / WANG WEI (Autor:in) / LIN ZEJUN (Autor:in) / REYNOLDS WESLEY (Autor:in) / LIU FENG (Autor:in) / HU JIANGTAO (Autor:in) / MIAO JINGHAO (Autor:in)

    Erscheinungsdatum :

    2024-01-31


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS



    Machine learning model fusing emergency vehicle audio and visual detection

    XU KECHENG / SUN HONGYI / LUO QI et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    EMERGENCY VEHICLE DETECTION FUSING AUDIO AND VISUAL DATA

    XU KECHENG / SUN HONGYI / LUO QI et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    MACHINE LEARNING MODEL TO FUSE EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION

    XU KECHENG / SUN HONGYI / LUO QI et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    MACHINE LEARNING MODEL TO FUSE EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION

    XU KECHENG / SUN HONGYI / LUO QI et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Machine learning model to fuse emergency vehicle audio and visual detection

    XU KECHENG / SUN HONGYI / LUO QI et al. | Europäisches Patentamt | 2023

    Freier Zugriff