We provide a new fully automatic framework to analyze facial action units, the fundamental building blocks of facial expression enumerated in Paul Ekman's facial action coding system (FACS). The action units examined here include upper facial muscle movements such as inner eyebrow raise, eye widening, and so forth, which combine to form facial expressions. Although prior methods have obtained high recognition rates for recognizing facial action units, these methods either use manually preprocessed image sequences or require human specification of facial features; thus, they have exploited substantial human intervention. We present a fully automatic method, requiring no such human specification. The system first robustly detects the pupils using an infrared sensitive camera equipped with infrared LEDs. For each frame, the pupil positions are used to localize and normalize eye and eyebrow regions, which are analyzed using PCA to recover parameters that relate to the shape of the facial features. These parameters are used as input to classifiers based on support vector machines to recognize upper facial action units and all their possible combinations. On a completely natural dataset with lots of head movements, pose changes and occlusions, the new framework achieved a recognition accuracy of 69.3% for each individual AU and an accuracy of 62.5% for all possible AU combinations. This framework achieves a higher recognition accuracy on the Cohn-Kanade AU-coded facial expression database, which has been previously used to evaluate other facial action recognition system.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Fully automatic upper facial action recognition


    Contributors:
    Kapoor, A. (author) / Qi, Y. (author) / Picard, R.W. (author)


    Publication date :

    2003-01-01


    Size :

    480871 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Fully Automatic Upper Facial Action Recognition

    Kapoor, A. / Qi, Y. / Picard, R. et al. | British Library Conference Proceedings | 2003


    Automatic Recognition of Human Facial Expressions

    Matsuno, K. / Lee, C.-W. / Kimura, S. et al. | British Library Conference Proceedings | 1995


    Simultaneous Facial Action Tracking and Expression Recognition Using a Particle Filter

    Dornaika, F. / Davoine, F. / IEEE | British Library Conference Proceedings | 2005


    A Vehicle Anti-Theft System Based on Facial Expression Action Recognition

    LIAO HAIBIN / XU BIN / WANG DIANHUA | European Patent Office | 2020

    Free access