It is becoming increasingly important to be able to credential and identify authorized personnel at key points of entry. Such identity management systems commonly employ biometric identifiers. In this paper, we present a novel multimodal facial recognition approach that employs data from both visible spectrum and thermal infrared sensors. Data from multiple cameras is used to construct a three-dimensional mesh representing the face and a facial thermal texture map. An annotated face model with explicit two-dimensional parameterization (UV) is then fitted to this data to construct: 1) a three-channel UV deformation image encoding geometry, and 2) a one-channel UV vasculature image encoding facial vasculature. Recognition is accomplished by comparing: 1) the parametric deformation images, 2) the parametric vasculature images, and 3) the visible spectrum texture maps. The novelty of our work lies in the use of deformation images and physiological information as means for comparison. We have performed extensive tests on the Face Recognition Grand Challenge v1.0 dataset and on our own multimodal database with very encouraging results.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multimodal face recognition: combination of geometry with physiological information


    Contributors:


    Publication date :

    2005-01-01


    Size :

    910712 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    8D-THERMO CAM: combination of geometry with physiological information for face recognition

    Kakadiaris, I.A. / Passalis, G. / Theoharis, T. et al. | IEEE | 2005

    Free access

    2D and 3D Multimodal Hybrid Face Recognition

    Mian, A. / Bennamoun, M. / Owens, R. | British Library Conference Proceedings | 2006


    Multimodal recognition using face profile and ear

    Li Yuan, / Zhichun Mu, / Ying Liu, | IEEE | 2006


    Multimodal 2D and 3D biometrics for face recognition

    Chang, K.I. / Bowyer, K.W. / Flynn, P.J. | IEEE | 2003


    Multimodal recognition fusing ear and profile face based on KPCA

    Xu Xiaona, / Zhao Yue, / Pan Xiuqin, | IEEE | 2008