There is accumulating evidence that drowsy driving is one of the leading causes of vehicle crashes and accidents worldwide. Consequently, automotive manufacturers started to develop in-vehicle drowsiness detection devices. However, due to the limited computation resources and the complexity of the vehicular environment, the existing products' performance is limited. Moreover, the vast majority of the commercialized products focus on monitoring the subject's current drowsiness level, whereas predicting drowsiness level in advance to avoid future risks is overlooked. In this research, a multi-time-scale fusion approach is proposed where prediction results from both long-term and short-term Recurrent Neural Networks (RNN) were combined to predict a person's drowsiness level. Our results indicate that the proposed fusion strategies can successfully capture both the short-term microsleep-related features and long-term sleepiness features and improve the drowsiness prediction performance. The effectiveness of our model was evaluated on the publicly available DROZY dataset with more than 252k frames, where the accuracy of long-term and short-term models outperform existing reported results, reached 97.9% and 71.4%, respectively. Experimental results showed that the implementation of parallel computation and asynchronous fusion ensured our system's processing speed is over 30 frames per second on an embedded computation platform, making it suitable for an in-vehicle application.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Prediction of Driver Drowsiness Level Using Recurrent Neural Networks and Multi-Time-Scale Fusion


    Additional title:

    Sae Technical Papers


    Contributors:

    Conference:

    SAE WCX Digital Summit ; 2021



    Publication date :

    2021-04-06




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Prediction of Driver Drowsiness Level Using Recurrent Neural Networks and Multi-Time-Scale Fusion

    Zhou, Xunfei / Kundu, Subrata | British Library Conference Proceedings | 2021


    Driver Drowsiness Detection using Convoluted Neural Networks

    Antony, Nihal / KR, Rohit / Patel, Shreya et al. | IEEE | 2019


    Driver drowsiness detection using multimodal sensor fusion

    Andreeva, Elena O. / Aarabi, Parham / Philiastides, Marios G. et al. | SPIE | 2004


    Multi-sensor driver drowsiness monitoring

    Boyraz,P. / Acar,M. / Kerr,D. et al. | Automotive engineering | 2008


    Multi-sensor driver drowsiness monitoring

    Boyraz, P / Acar, M / Kerr, D | SAGE Publications | 2008