Many road accidents occur due to distracted drivers. Today, driver monitoring is essential even for the latest autonomous vehicles to alert distracted drivers in order to take over control of the vehicle in case of emergency. In this paper, a spatio-temporal approach is applied to classify drivers’ distraction level and movement decisions using convolutional neural networks (CNNs). We approach this problem as action recognition to benefit from temporal information in addition to spatial information. Our approach relies on features extracted from sparsely selected frames of an action using a pre-trained BN-Inception network. Experiments show that our approach outperforms the state-of-the art results on the Distracted Driver Dataset (96.31%), with an accuracy of 99.10% for 10-class classification while providing real-time performance. We also analyzed the impact of fusion using RGB and optical flow modalities with a very recent data level fusion strategy. The results on the Distracted Driver and Brain4Cars datasets show that fusion of these modalities further increases the accuracy.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Real-Time Driver State Monitoring Using a CNN Based Spatio-Temporal Approach*


    Contributors:


    Publication date :

    2019-10-01


    Size :

    1705590 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Real-time Attention-Augmented Spatio-Temporal Networks for Video-based Driver Activity Recognition

    Saleh, Khaled / Mihaita, Adriana-Simona / Yu, Kun et al. | IEEE | 2022



    Driver state real-time monitoring system based on AIoT

    FENG WEIJIA / DING RUMENG / DENG YUPING et al. | European Patent Office | 2020

    Free access

    SPATIO-TEMPORAL INDEXING METHOD FOR DRIVER MANEUVERS AND DRIVER EVALUATION METHOD USING SAME

    SONG SEOK IL / MUN CHEOL | European Patent Office | 2018

    Free access

    A Real-Time Vision System for Automatic Traffic Monitoring Based on 2D Spatio-Temporal Images

    Zhu, Z. / Yang, B. / Xu, G. et al. | British Library Conference Proceedings | 1996