Machine learning systems and methods that determine gaze direction by using face orientation information, such as facial landmarks, to modify eye direction information determined from images of the subject's eyes. System inputs include eye crops of the eyes of the subject, as well as face orientation information such as facial landmarks of the subject's face in the input image. Facial orientation information, or facial landmark information, is used to determine a coarse prediction of gaze direction as well as to learn a context vector of features describing subject face pose. The context vector is then used to adaptively re-weight the eye direction features determined from the eye crops. The re-weighted features are then combined with the coarse gaze prediction to determine gaze direction.


    Access

    Download


    Export, share and cite



    Title :

    GAZE DETERMINATION MACHINE LEARNING SYSTEM HAVING ADAPTIVE WEIGHTING OF INPUTS


    Contributors:

    Publication date :

    2021-06-17


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V



    GAZE DETERMINATION MACHINE LEARNING SYSTEM HAVING ADAPTIVE WEIGHTING OF INPUTS

    PURI NISHANT | European Patent Office | 2023

    Free access

    Gaze determination machine learning system having adaptive weighting of inputs

    PURI NISHANT | European Patent Office | 2023

    Free access

    Gaze determination machine learning system having adaptive weighting of inputs

    PURI NISHANT | European Patent Office | 2025

    Free access

    VEHICLE HAVING GAZE RECOGNIZING FUNCTION AND CONTROLLING METHOD THEREOF, AND GAZE RECOGNIZING SYSTEM

    OH KWANG MYUNG / SAH SUNG JIN / PARK SUNG MIN et al. | European Patent Office | 2016

    Free access