Driving inattention caused by drowsiness has been a significant reason for vehicle crash accidents, and there is a critical need to augment driving safety by monitoring driver drowsiness behaviors. For real-time drowsy driving awareness, we propose a vision-based driver drowsiness monitoring system (DDMS) for driver drowsiness behavior recognition and analysis. First, an infrared camera is deployed in-vehicle to capture the driver’s facial and head information in naturalistic driving scenarios, in which the driver may or may not wear glasses or sunglasses. Second, we propose and design a multi-modal features representation approach based on facial landmarks, and head pose which is retrieved in a convolutional neural network (CNN) regression model. Finally, an extreme learning machine (ELM) model is proposed to fuse the facial landmark, recognition model and pose orientation for drowsiness detection. The DDMS gives promptly warning to the driver once a drowsiness event is detected. The proposed CNN and ELM models are trained in a drowsy driving dataset and are validated on public datasets and field tests. Comparing to the end-to-end CNN recognition model, the proposed multi-modal fusion with the ELM detection model allows faster and more accurate detection with minimal intervention. The experimental result demonstrates that DDMS is able to provide real-time and effective drowsy driving alerts under various light conditions to augment driving safety.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Driver Drowsiness Behavior Detection and Analysis Using Vision-Based Multimodal Features for Driving Safety


    Additional title:

    Sae Technical Papers


    Contributors:

    Conference:

    WCX SAE World Congress Experience ; 2020



    Publication date :

    2020-04-14




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Driver Drowsiness Behavior Detection and Analysis Using Vision-Based Multimodal Features for Driving Safety

    Li, Rui / Brand, Howard / Gopinath, Aditya et al. | British Library Conference Proceedings | 2020


    Driver Drowsiness Behavior Detection and Analysis Using Vision-Based Multimodal Features for Driving Safety

    Li, Rui / Brand, Howard / Gopinath, Aditya et al. | British Library Conference Proceedings | 2020


    Computer Vision Based Driver Assistance Drowsiness Detection

    Emashharawi, Maryam J. S. / Khalifa, Othman O. / Abdul Malik, Noreha et al. | Springer Verlag | 2021


    Driver Drowsiness Detection

    Satish, K. / Lalitesh, A. / Bhargavi, K. et al. | IEEE | 2020


    Driver Drowsiness Detection

    Rezaei, Mahdi / Klette, Reinhard | Springer Verlag | 2017