A system and method for inferring operator intent by detecting operator focus incorporates cameras positioned within a cockpit or control space of a vehicle and oriented at an operator of the vehicle. The cameras capture images of the operator in a control seat; the images are analyzed (either individually or sequentially) to determine a gaze and/or body pose of the operator (including, e.g., a position and orientation of the torso and limbs). By comparing the determined gaze and/or body pose to the positions and orientations of potential focus targets within the control space (e.g., windows, display units, and/or control panels that the operator may engage with visually and/or physically), the system predicts the most likely future focus target or targets: what the operator is most likely to visually and/or physically engage with next. Operator intent may be further analyzed to identify potentially abnormal or anomalous behavior.


    Access

    Download


    Export, share and cite



    Title :

    System and method for gaze and pose detection to anticipate operator intent


    Contributors:
    WU PEGGY (author) / OSMAN AHMAD F (author)

    Publication date :

    2024-04-16


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / B64D Ausrüstung für Flugzeuge , EQUIPMENT FOR FITTING IN OR TO AIRCRAFT / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G06V



    SYSTEM AND METHOD FOR GAZE AND POSE DETECTION TO ANTICIPATE OPERATOR INTENT

    WU PEGGY / OSMAN AHMAD F | European Patent Office | 2023

    Free access

    Super ferries anticipate growth

    Online Contents | 1994


    INTERACTION BASED ON CAPTURING USER INTENT VIA EYE GAZE

    RIGAZIO LUCA / CARLIN CASEY JOSEPH / LANG ANGELIQUE CAMILLE et al. | European Patent Office | 2017

    Free access


    We anticipate for 1930

    Engineering Index Backfile | 1930