Abstract In this chapter, we present our recent results on the multilevel Bayesian decision fusion scheme for multimodal audio-visual speaker identification problem. The objective is to improve the recognition performance over conventional decision fusion schemes. The proposed system decomposes the information existing in a video stream into three components: speech, lip trace and face texture. Lip trace features are extracted based on 2D-DCT transform of the successive active lip frames. The mel-frequency cepstral coefficients (MFCC) of the corresponding speech signal are extracted in parallel to the lip features. The resulting two parallel and synchronous feature vectors are used to train and test a two stream Hidden Markov Model (HMM) based identification system. Face texture images are treated separately in eigenface domain and integrated to the system through decision-fusion. Reliability based ordering in multilevel decision fusion is observed to be significantly robust at all SNR levels.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Joint Audio-Video Processing for Robust Biometric Speaker Identification in Car


    Contributors:


    Publication date :

    2005-01-01


    Size :

    20 pages




    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Audio speaker cabinet

    O'NEAL KENNETH BRIAN | European Patent Office | 2015

    Free access

    SPEAKER SYSTEM, SPEAKER SYSTEM COMPONENT, AND AUDIO SYSTEM

    FUJIMOTO KEISUKE / SANO KOJI / MIYAMOTO YASUNORI et al. | European Patent Office | 2019

    Free access

    VIDEO PROCESSING FOR VEHICLE RIDE INCORPORATING BIOMETRIC DATA

    PAPP ETHAN | European Patent Office | 2021

    Free access

    Video processing for vehicle ride incorporating biometric data

    PAPP ETHAN | European Patent Office | 2022

    Free access

    Audio system with removable speaker

    WIPPLER ERIK ANTHONY | European Patent Office | 2017

    Free access