Machine learning systems and methods that determine gaze direction by using face orientation information, such as facial landmarks, to modify eye direction information determined from images of the subject’s eyes. System inputs include eye crops of the eyes of the subject, as well as face orientation information such as facial landmarks of the subject’s face in the input image. Facial orientation information, or facial landmark information, is used to determine a coarse prediction of gaze direction as well as to learn a context vector of features describing subject face pose. The context vector is then used to adaptively re-weight the eye direction features determined from the eye crops. The re-weighted features are then combined with the coarse gaze prediction to determine gaze direction.
GAZE DETERMINATION MACHINE LEARNING SYSTEM HAVING ADAPTIVE WEIGHTING OF INPUTS
2023-06-29
Patent
Electronic Resource
English
IPC: | G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V |
GAZE DETERMINATION MACHINE LEARNING SYSTEM HAVING ADAPTIVE WEIGHTING OF INPUTS
European Patent Office | 2021
|Gaze determination machine learning system having adaptive weighting of inputs
European Patent Office | 2025
|Gaze determination machine learning system having adaptive weighting of inputs
European Patent Office | 2023
|VEHICLE HAVING GAZE RECOGNIZING FUNCTION AND CONTROLLING METHOD THEREOF, AND GAZE RECOGNIZING SYSTEM
European Patent Office | 2016
|VEHICLE HAVING GAZE RECOGNIZING FUNCTION AND CONTROLLING METHOD THEREOF AND GAZE RECOGNIZING SYSTEM
European Patent Office | 2016