This paper presents a method for learning decision theoretic models of facial expressions and gestures from video data. We consider that the meaning of a facial display or gesture to an observer is contained in its relationship to context, actions and outcomes. An agent wishing to capitalize on these relationships must distinguish facial displays and gestures according to how they help the agent to maximize utility. This paper demonstrates how an agent can learn relationships between unlabeled observations of a person's face and gestures, the context, and its own actions and utility function. The agent needs no prior knowledge about the number or the structure of the gestures and facial displays that are valuable to distinguish. The agent discovers classes of human non-verbal behaviors, as well as which are important for choosing actions that optimize over the utility of possible outcomes. This value-directed model learning allows an agent to focus resources on recognizing only those behaviors which are useful to distinguish. We show results in a simple gestural robotic control problem and in a simple card game played by two human players.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Value directed learning of gestures and facial displays


    Contributors:
    Hoey, J. (author) / Little, J.J. (author)


    Publication date :

    2004-01-01


    Size :

    1029890 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Value Directed Learning of Gestures and Facial Displays

    Hoey, J. / Little, J. / IEEE Computer Society | British Library Conference Proceedings | 2004


    Learning of Facial Gestures Using SVMs

    Baltes, J. / Seo, S. / Cheng, C.T. et al. | British Library Conference Proceedings | 2011


    Learning of Facial Gestures Using SVMs

    Baltes, Jacky / Seo, Stela / Cheng, Chi Tai et al. | Springer Verlag | 2011


    Classifying Facial Gestures in Presence of Head Motion

    Wei-Kai Liao, / Cohen, I. | IEEE | 2005


    VEHICLE MOUNTED VIRTUAL VISOR SYSTEM HAVING FACIAL EXPRESSION CONTROL GESTURES

    TODD RYAN / ZINK JASON / WOODRICH ANDY | European Patent Office | 2023

    Free access