Abstract Fatigue negatively affects the safety and performance of drivers on the road. In fact, drowsiness and fatigue are the cause of a substantial number of motor vehicle accidents. Drowsiness among the drivers can be detected using variety of modalities, including electroencephalogram (EEG), eye movement, and vehicle driving dynamics. Among these EEG is highly accurate but very intrusive and cumbersome. On the other hand, vehicle driving dynamics are very easy to acquire but accuracy is not very high. Eye movement based approach is very attractive in terms of balance between these two extremes. However, eye movement based techniques normally require an eye tracking device which consists of high speed camera with sophisticated algorithm to extract eye movement related parameters such as blinking, eye closure, saccades, fixation etc. This makes eye tracking based drowsiness detection difficult to implement as a practical system, especially on an embedded platform. In this paper, authors propose to use eye images from camera directly without the need for expensive eye-tracking system. Here, eye related movements are captured by Recurrent Neural Network (RNN) to detect the drowsiness. Long Short Term Memory (LSTM) is a class of RNN which has several advantages over vanilla RNNs. In this work an array of LSTM cells are utilized to model the eye movements. Two types of LSTMs were employed: 1-D LSTM (R-LSTM) which is used as baseline and the convolutional LSTM (C-LSTM) which facilitates using 2-D images directly. Patches of size 48 × 48 around each eye were extracted from 38 subjects, participating in a simulated driving experiment. The state of vigilance among the subjects were independently assessed by power spectral analysis of multichannel electroencephalogram (EEG) signals, recorded simultaneously, and binary labels of alert and drowsy (baseline) were generated. Results show high efficacy of the proposed system. R-LSTM based approach resulted in accuracy around 82 % and C-LSTM based approach resulted in accuracy in the range of 95%–97%. Comparison is also provided with a recently published eye-tracking based approach, showing the proposed LSTM technique outperform with a wide margin.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Using long short term memory and convolutional neural networks for driver drowsiness detection


    Beteiligte:
    Quddus, Azhar (Autor:in) / Shahidi Zandi, Ali (Autor:in) / Prest, Laura (Autor:in) / Comeau, Felix J.E. (Autor:in)


    Erscheinungsdatum :

    2021-03-27




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Driver Drowsiness Detection using Convolutional Neural Networks(CNNs)

    Shereesha, M. / Sreehitha, G. / Reddy, G.Rohan et al. | IEEE | 2023


    Driver Drowsiness Monitoring using Convolutional Neural Networks

    Victoria, D. Rosy Salomi / Mary, D. Glory Ratna | IEEE | 2021


    Long Short-Term Memory Networks for Driver Drowsiness and Stress Prediction

    Chui, Kwok Tai / Zhao, Mingbo / Gupta, Brij B. | Springer Verlag | 2021


    Driver Drowsiness Detection Using Convolution Neural Networks

    Ravi Teja, P. / Anjana Gowri, G. / Preethi Lalithya, G. et al. | Springer Verlag | 2021


    Automated Driver Drowsiness Detection from Single-Channel EEG Signals Using Convolutional Neural Networks and Transfer Learning

    Ghadami, Ali / Mohammadzadeh, Mohammad / Taghimohammadi, Mohammadreza et al. | IEEE | 2022