This paper presents the method of detecting driver's drowsiness level from the facial expression. The motivation for this research is to realize the novel safety system which can detect the driver's slight drowsiness and keep the driver awake while driving. The brain wave is commonly used as the drowsiness index. However, it is not suitable for the in-vehicle system since it is measured with sensors worn over the head. We precisely investigated the relationship between the change of brain wave and other drowsiness indices that can be measured without any contact; PERCLOS, heart rate, lane deviation, and facial expression. We found that the facial expression index had the highest linear correlation with the brain wave. Therefore, the authors selected the facial expression as the drowsiness-detection index and automated the drowsiness detection from the facial expression. Three problems need to be solved for automation; (1) how to define the features of drowsy expression, (2) how to capture the features from the driver's video-recorded facial image, and (3) how to estimate the driver's drowsiness index from the features. First, it is found that frontalis muscle, zygomaticus major muscle, and masseter muscle activated with increase of drowsiness in more than 75 percents of participants. According to the result, we determined the coordinates data of points on eyebrows, eyelids, and mouth as the features of drowsiness expression. Second, the 3D coordinates data of the features by image processing with Active Appearance Model (AAM)will be calculated. Third, the k-Nearest-Neighbour method to classify the driver's drowsiness level will be applied. Eleven participants' data of the features and the drowsiness level estimated by trained observers were used as the training data. We achieved the classification of the drivers' drowsiness in a driving simulator into 6 levels. The average Root Mean Square Errors (RMSE) among 12 participants was less than 1.0 level.


    Zugriff

    Zugriff über TIB

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Drowsiness detection using facial expression features


    Weitere Titelangaben:

    Müdigkeitserkennung mit Hilfe von Gesichtsmerkmalen


    Beteiligte:
    Hachisuka, Satori (Autor:in) / Kumura, Teiyuu (Autor:in) / Ishida, Kenji (Autor:in) / Nakatani, Hiroto (Autor:in) / Ozaki, Noriyuki (Autor:in)


    Erscheinungsdatum :

    2010


    Format / Umfang :

    10 Seiten, 15 Bilder, 3 Tabellen, 19 Quellen




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    Drowsiness Detection Using Facial Expression Features

    Nakatani, Hiroto / Ishida, Kenji / Ozaki, Noriyuki et al. | SAE Technical Papers | 2010


    Drowsiness detection using facial expression features

    Hachisuka,S. / Kimura,T. / Ishida,K. et al. | Kraftfahrwesen | 2010


    Drowsiness Detection Using IoT and Facial Expression

    Ashlin Deepa, R. N. / Sai Rakesh Reddy, DontiReddy / Milind, K. et al. | Springer Verlag | 2023


    Drowsiness Detection Using Facial Features, Image Processing and Machine Learning

    Nandhini, S. / Venkatasubramanian, Vaishnavi / Aparna, C. | Springer Verlag | 2022


    Driver Drowsiness Detection From Multiple Facial Features Using Mobile Devices

    John, Jyothish K / Jose, Jenat / Cyriac, Deepu et al. | IEEE | 2023