An analysis of drivers' facial expressions and subsidiary behavior events (e.g., yawning, self-touching hand motions, etc.) revealed a significant correlation between the struggle against sleepiness and the frequency of occurrence of such events. We counted drivers' subsidiary behavior events by video analysis and defined nine categories of events related to the mouth, hands, head, shoulders, body and eyes. Mouth-related events were further categorized as yawning, stifling a yawn, exhaling and deep breathing. Yawning and self-touching hand motions in particular were observed in relatively large numbers among subsidiary behavior events. Based on this observation, we created an algorithm for detecting yawning and self-touching hand motions using a monocular camera and calculated the frequency of these subsidiary behavior events. In experiments, we compared the frequency of the subsidiary behavior events at the outset of driving and after the passage of time. As a result, we found time frames with a higher frequency of subsidiary events than at the outset, indicating an imminent decline in alertness based on a comparison with drivers' facial expressions. Our results show that the proposed method can detect a decrease in alertness earlier than the conventional eye closure rate method.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Early Detection of Reduced Alertness using Subsidiary Behavior


    Additional title:

    Sae Technical Papers


    Contributors:

    Conference:

    SAE 2012 World Congress & Exhibition ; 2012



    Publication date :

    2012-04-16




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English


    Keywords :


    Early Detection of Reduced Alertness using Subsidiary Behavior

    Matsuo, H. / Khiat, A. / Society of Automotive Engineers | British Library Conference Proceedings | 2012


    ALERTNESS ASSISTANCE DEVICE AND ALERTNESS ASSISTANCE METHOD

    MAEDA KAZUHIKO | European Patent Office | 2023

    Free access

    ALERTNESS DEVICE, SEAT, AND METHOD FOR DETERMINING ALERTNESS

    SUGIYAMA SHINJI / ITO TAKAYOSHI / YOKOYAMA KIYOKO et al. | European Patent Office | 2019

    Free access

    ALERTNESS DEVICE, SEAT, AND METHOD FOR DETERMINING ALERTNESS

    SUGIYAMA SHINJI / ITO TAKAYOSHI / YOKOYAMA KIYOKO et al. | European Patent Office | 2016

    Free access

    Alertness device, seat, and method for determining alertness

    SUGIYAMA SHINJI / ITO TAKAYOSHI / YOKOYAMA KIYOKO et al. | European Patent Office | 2018

    Free access