Distracted driving is a problem which yearly causes a large amount of road traffic crashes with high rates of fatalities and injured persons. Recently, car manufacturers started to integrate driver monitoring systems to detect visual distraction. This paper proposes a method to extend such systems by driver posture classification to detect driver cell phone usage and food consumption. Such an extension can be beneficial since systems that focus on the detection of visual distraction mainly rely on head pose and gaze information. Thus, distraction caused by cell phone usage or food consumption can not be detected by these systems when the driver is looking to the road ahead. To robustly detect those types of manual and cognitive distraction, different deep learning models were trained and evaluated based on a new image dataset which was captured by two infrared cameras to ensure that a large range of head angles can be covered by the system. Separate Convolutional Neural Networks (CNNs) were trained and evaluated for the dataset of the left and the right camera to optimize the classification accuracy. The trained CNNs revealed a competitive test accuracy of 92.88% and 90.36% for the left and the right camera, respectively. In inference mode, the models achieve a frame rate of 44Hz and 28Hz for the left and the right camera, respectively. The combination of the classification output of both networks revealed a test accuracy of 92.54%.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Vision Based Detection of Driver Cell Phone Usage and Food Consumption


    Contributors:


    Publication date :

    2022-05-01


    Size :

    5267971 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Detection of mobile phone usage

    MIAO ALAN | European Patent Office | 2018

    Free access

    VEHICLE-BASED MOBILE DEVICE USAGE MONITORING WITH A CELL PHONE USAGE SENSOR

    MUELLER PAUL ANTHON / DOLINSKY JR JOHN / SVENSON THOMAS ERIC et al. | European Patent Office | 2018

    Free access

    Vehicle-based mobile device usage monitoring with a cell phone usage sensor

    MUELLER PAUL ANTHON / DOLINSKY JR JOHN / SVENSON THOMAS ERIC et al. | European Patent Office | 2019

    Free access

    Assessing Driver Distraction from Cell Phone Use

    Schattler, Kerrie L. / Pellerito, Joseph / McAvoy, Deborah et al. | Transportation Research Record | 2006