A system and method for inferring operator intent by detecting operator focus incorporates cameras positioned within a cockpit or control space of a vehicle and oriented at an operator of the vehicle. The cameras capture images of the operator in a control seat; the images are analyzed (either individually or sequentially) to determine a gaze and/or body pose of the operator (including, e.g., a position and orientation of the torso and limbs). By comparing the determined gaze and/or body pose to the positions and orientations of potential focus targets within the control space (e.g., windows, display units, and/or control panels that the operator may engage with visually and/or physically), the system predicts the most likely future focus target or targets: what the operator is most likely to visually and/or physically engage with next. Operator intent may be further analyzed to identify potentially abnormal or anomalous behavior.
System and method for gaze and pose detection to anticipate operator intent
2024-04-16
Patent
Electronic Resource
English
SYSTEM AND METHOD FOR GAZE AND POSE DETECTION TO ANTICIPATE OPERATOR INTENT
European Patent Office | 2023
|Super ferries anticipate growth
Online Contents | 1994
NS: Anticipate, adapt, accomplish
Online Contents | 2013
Engineering Index Backfile | 1930