The aim of this paper is to classify the driver tiredness and fatigue in automobile via eye tracking and body movements using deep learning based Convolutional Neural Network (CNN) algorithm. Vehicle driver face localization serves as one of the most widely used real-world applications in fields like toll control, traffic accident scene analysis, and suspected vehicle tracking. The research proposed a CNN classifier for simultaneously localizing the region of human face and eye positioning. The classifier, rather than bounding rectangles, gives bounding quadrilaterals, which gives a more precise indication for vehicle driver face localization. The adjusted regions are preprocessed to remove noise and passed to the CNN classifier for real time processing. The preprocessing of the face features extracts connected components, filters them by size, and groups them into face expressions. The employed CNN is the well-known technology for human face recognition. One we aim to extract the facial landmarks from the frames, we will then leverage classification models and deep learning based convolutional neural networks that predict the state of the driver as 'Alert' or 'Drowsy' for each of the frames extracted. The CNN model could predict the output state labels (Alert/Drowsy) for each frame, but we wanted to take care of sequential image frames as that is extremely important while predicting the state of an individual. The process completes, if all regions have a sufficiently high score or a fixed number of retries are exhausted. The output consists of the detected human face type, the list of regions including the extracted mouth and eyes with recognition reliability through CNN with an accuracy of 98.57% with 100 epochs of training and testing.


    Access

    Download


    Export, share and cite



    Title :

    Computing driver tiredness and fatigue in automobile via eye tracking and body movements


    Contributors:

    Publication date :

    2022-02-09


    Remarks:

    doi:10.21533/pen.v10i1.2705
    Periodicals of Engineering and Natural Sciences; Vol 10, No 1 (2022); 573-586 ; 2303-4521 ; 10.21533/pen.v10i1



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629





    Tackling driver tiredness: raising awareness, reducing risk

    Jackson, P. / Department for Transport | British Library Conference Proceedings | 2004


    VEHICLE WITH A SAFETY SYSTEM INVOLVING PREDICTION OF DRIVER TIREDNESS

    KOLLEGGER PETER / CLAEZON FREDRICH / FRID ALEXANDRA et al. | European Patent Office | 2018

    Free access

    Vehicle with a safety system involving prediction of driver tiredness

    KOLLEGGER PETER / CLAEZON FREDRICH / FRID ALEXANDRA et al. | European Patent Office | 2016

    Free access