This paper presents a method for learning decision theoretic models of facial expressions and gestures from video data. We consider that the meaning of a facial display or gesture to an observer is contained in its relationship to context, actions and outcomes. An agent wishing to capitalize on these relationships must distinguish facial displays and gestures according to how they help the agent to maximize utility. This paper demonstrates how an agent can learn relationships between unlabeled observations of a person's face and gestures, the context, and its own actions and utility function. The agent needs no prior knowledge about the number or the structure of the gestures and facial displays that are valuable to distinguish. The agent discovers classes of human non-verbal behaviors, as well as which are important for choosing actions that optimize over the utility of possible outcomes. This value-directed model learning allows an agent to focus resources on recognizing only those behaviors which are useful to distinguish. We show results in a simple gestural robotic control problem and in a simple card game played by two human players.
Value directed learning of gestures and facial displays
2004-01-01
1029890 byte
Conference paper
Electronic Resource
English
Value Directed Learning of Gestures and Facial Displays
British Library Conference Proceedings | 2004
|Learning of Facial Gestures Using SVMs
British Library Conference Proceedings | 2011
|Learning of Facial Gestures Using SVMs
Springer Verlag | 2011
|Classifying Facial Gestures in Presence of Head Motion
IEEE | 2005
|VEHICLE MOUNTED VIRTUAL VISOR SYSTEM HAVING FACIAL EXPRESSION CONTROL GESTURES
European Patent Office | 2023
|