Methods, apparatus, and systems are provided for integrated driver expression recognition and vehicle interior environment classification to detect driver condition for safety. A method includes obtaining an image of a driver of a vehicle and an image of an interior environment of the vehicle. Using a machine learning method, the images are processed to classify a condition of the driver and of the interior environment of the vehicle. The machine learning method includes general convolutional neural network (CNN) and CNN with adaptive filters. The adaptive filters are determined based on influence of filters. The classification results are combined and compared with predetermined thresholds to determine if a decision can be made based on existing information. Additional information is requested by self-motivated learning if a decision cannot be made, and safety is determined based on the combined classification results. A warning is provided to the driver based on the safety determination.


    Access

    Download


    Export, share and cite



    Title :

    Integrated system for detection of driver condition


    Contributors:
    ZHU YINGXUAN (author) / LIU LIFENG (author) / YIN XIAOTIAN (author) / ZHANG JUN (author) / LI JIAN (author)

    Publication date :

    2020-03-17


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60K Anordnung oder Einbau von Antriebseinheiten oder von Kraft- bzw. Drehmomentübertragungen in Fahrzeugen , ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06V



    INTEGRATED SYSTEM FOR DETECTION OF DRIVER CONDITION

    ZHU YINGXUAN / LIU LIFENG / YIN XIAOTIAN et al. | European Patent Office | 2019

    Free access

    Driver condition detection system

    MATSUMURA TAKESHI | European Patent Office | 2021

    Free access

    DRIVER CONDITION DETECTION SYSTEM

    SATO JUN / HARA KENICHIROH / KASUGAI JUNYA et al. | European Patent Office | 2019

    Free access

    DRIVER CONDITION DETECTION SYSTEM

    MATSUMURA TAKESHI | European Patent Office | 2018

    Free access

    DRIVER CONDITION DETECTION SYSTEM

    MATSUMURA TAKESHI | European Patent Office | 2018

    Free access