To provide systems and methods for more accurate and robust determination of subject characteristics from an image of the subject.SOLUTION: One or more machine learning models receive as input an image of a subject, and output both facial landmarks and associated confidence values. The confidence values represent degrees to which portions of the subject's face corresponding to landmarks of the subject's face are occluded, i.e., uncertainty of the position of each landmark location. These landmark points and their associated confidence values, and/or associated information, may then be input to another set of one or more machine learning models, which output any facial analysis quantities, such as the subject's gaze direction (gaze network) 230, head pose 240, drowsiness state 250, cognitive load, or distraction state.SELECTED DRAWING: Figure 2

    【課題】被験者の画像から被験者の特徴をより正確かつ堅固に決定するシステム及び方法を提供する。【解決手段】1つ以上の機械学習モデルは、入力として被験者の画像を受信し、顔のランドマーク及び関連する信頼値の両方を出力する。信頼値は、被験者の顔のランドマークに対応する被験者の顔の部分が遮蔽されている程度、つまり各ランドマーク箇所の位置の不確実性を表す。これらのランドマーク点及び関連する信頼値、及び/又は関連する情報を、次に、1つ以上の機械学習モデルの別のセットに入力し、被験者の視線方向(視線ネットワーク)230、頭の姿勢240、傾眠状態250、認知負荷、又は注意散漫状態などの顔分析量が出力される。【選択図】図2


    Access

    Download


    Export, share and cite



    Title :

    NEURAL NETWORK BASED FACIAL ANALYSIS USING FACIAL LANDMARKS AND ASSOCIATED CONFIDENCE VALUES


    Additional title:

    顔のランドマーク及び関連する信頼値を使用したニューラルネットワークベースの顔分析


    Contributors:

    Publication date :

    2021-06-24


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Japanese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / A61B DIAGNOSIS , Diagnostik / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G06V / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G09G Anordnungen oder Schaltungen zur Steuerung oder Regelung von Anzeigevorrichtungen mit statischen Mitteln zur Darstellung veränderlicher Informationen , ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION



    Drivers’ Visual Distraction Detection Using Facial Landmarks and Head Pose

    Zhang, Shile / Abdel-Aty, Mohamed | Transportation Research Record | 2022


    Driver State Alert Control using Head Shoulder Inclination and Facial Landmarks

    Ashitha Ebrahim / Fathimathul Harshima P. T. / Aby Abahai T | BASE | 2020

    Free access

    Eye Fatigue Detection in Vehicle Drivers Based on Facial Landmarks Features

    Fikriyah, Fia Dumi Hasanatul / Nugroho, Anan / Suni, Alfa Faridh | BASE | 2021

    Free access

    Neural network method through facial expression recognition

    Kushwah, Kavita / Sharma, Vikrant / Singh, Upendra | IEEE | 2017


    Real-Time Facial Expression Recognition Using Deep Convolutional Neural Network

    Zeng, Yuwen / Xiao, Nan / Wang, Kaidi et al. | British Library Conference Proceedings | 2019