Drowsiness detection is a crucial step for safe driving. A plethora of efforts has been invested on using pervasive sensor data (e.g., video, physiology) empowered by machine learning to build an automatic drowsiness detection system. Nevertheless, most of the existing methods are based on complicated wearables (e.g., electroencephalogram) or computer vision algorithms (e.g., eye state analysis), which makes the relevant systems hardly applicable in the wild. Furthermore, data based on these methods are insufficient in nature due to limited simulation experiments. In this light, we propose a novel and easily implemented method based on full non-invasive multimodal machine learning analysis for the driver drowsiness detection task. The drowsiness level was estimated by self-reported questionnaire in pre-designed protocols. First, we consider involving environmental data (e.g., temperature, humidity, illuminance, and further more), which can be regarded as complementary information for the human activity data recorded via accelerometers or actigraphs. Second, we demonstrate that the models trained by daily life data can still be efficient to make predictions for the subject performing in a simulator, which may benefit the future data collection methods. Finally, we make a comprehensive study on investigating different machine learning methods including classic ‘shallow’ models and recent deep models. Experimental results show that, our proposed methods can reach 64.6% unweighted average recall for drowsiness detection in a subject-independent scenario.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Learning Multimodal Representations for Drowsiness Detection


    Contributors:


    Publication date :

    2022-08-01


    Size :

    1864731 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    DROWSINESS DETECTION DEVICE AND DROWSINESS DETECTION METHOD

    AGENO FUTOSHI / HIGUCHI DAIKI | European Patent Office | 2022

    Free access

    DRIVER DROWSINESS DETECTION SYSTEM USING IMAGE AND PPG DATA BASED ON MULTIMODAL DEEP LEARNING

    LEE KYU CHUL / BACK MOON KI | European Patent Office | 2020

    Free access

    Deep Learning based Driver Drowsiness Detection

    Buddhi, Dharam / Negi, Poonam | IEEE | 2022


    Drowsiness detection apparatus and drowsiness detection method thereof

    LIU ZHEN-TE / CHEN YU-YEN | European Patent Office | 2019

    Free access

    DROWSINESS DETECTION APPARATUS AND DROWSINESS DETECTION METHOD THEREOF

    LIU ZHEN-TE / CHEN YU-YEN | European Patent Office | 2019

    Free access