Methods, apparatus, and systems are provided for integrated driver expression recognition and vehicle interior environment classification to detect driver condition for safety. A method includes obtaining an image of a driver of a vehicle and an image of an interior environment of the vehicle. Using a machine learning method, the images are processed to classify a condition of the driver and of the interior environment of the vehicle. The machine learning method includes general convolutional neural network (CNN) and CNN with adaptive filters. The adaptive filters are determined based on influence of filters. The classification results are combined and compared with predetermined thresholds to determine if a decision can be made based on existing information. Additional information is requested by self-motivated learning if a decision cannot be made, and safety is determined based on the combined classification results. A warning is provided to the driver based on the safety determination.
INTEGRATED SYSTEM FOR DETECTION OF DRIVER CONDITION
2019-01-17
Patent
Electronic Resource
English
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06V |