Audio analysis learning is performed using video data. Video data is obtained, on a first computing device, wherein the video data includes images of one or more people. Audio data is obtained, on a second computing device, which corresponds to the video data. A face within the video data is identified. A first voice, from the audio data, is associated with the face within the video data. The face within the video data is analyzed for cognitive content. Audio features corresponding to the cognitive content of the video data are extracted. The audio data is segmented to correspond to an analyzed cognitive state. An audio classifier is learned, on a third computing device, based on the analyzing of the face within the video data. Further audio data is analyzed using the audio classifier.


    Access

    Download


    Export, share and cite



    Title :

    AUDIO ANALYSIS LEARNING WITH VIDEO DATA


    Contributors:

    Publication date :

    2019-06-06


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS / B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06K Erkennen von Daten , RECOGNITION OF DATA



    Audio analysis learning with video data

    MISHRA TANIYA / EL KALIOUBY RANA | European Patent Office | 2020

    Free access

    AUDIO ANALYSIS LEARNING USING VIDEO DATA

    MISHRA TANIYA / EL KALIOUBY RANA | European Patent Office | 2018

    Free access

    Audio analysis learning using video data

    MISHRA TANIYA / EL KALIOUBY RANA | European Patent Office | 2019

    Free access


    Roadside Video Data Analysis : Deep Learning

    Verma, Brijesh ;Stockwell, David ;Zhang, Ligang | SLUB | 2017