Abstract The distracted phone‐use behaviours among pedestrians, like Texting, Game Playing and Phone Calls, have caused increasing fatalities and injuries. However, the research of phone‐related distracted behaviour by pedestrians has not been systemically studied. It is desired to improve both the driving and pedestrian safety by automatically discovering the phone‐related pedestrian distracted behaviours. Herein, a new computer vision‐based method is proposed to detect the phone‐related pedestrian distracted behaviours from a view of intelligent and autonomous driving. Specifically, the first end‐to‐end deep learning based Two‐Branch Convolutional Neural Network (CNN) is designed for this task. Taking one synchronised image pair by two front on‐car GoPro cameras as the inputs, the proposed two‐branch CNN will extract features for each camera, fuse the extracted features and perform a robust classification. This method can also be easily extended to video‐based classification by confidence accumulation and voting. A new benchmark dataset of 448 synchronised video pairs of 53,760 images collected on a vehicle is proposed for this research. The experimental results show that using two synchronised cameras obtained better performance than using one single camera. Finally, the proposed method achieved an overall best classification accuracy of 84.3% on the new benchmark when compared to other methods.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Detecting phone‐related pedestrian distracted behaviours via a two‐branch convolutional neural network


    Beteiligte:
    Humberto Saenz (Autor:in) / Huiming Sun (Autor:in) / Lingtao Wu (Autor:in) / Xuesong Zhou (Autor:in) / Hongkai Yu (Autor:in)


    Erscheinungsdatum :

    2021




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Detecting phone‐related pedestrian distracted behaviours via a two‐branch convolutional neural network

    Saenz, Humberto / Sun, Huiming / Wu, Lingtao et al. | Wiley | 2021

    Freier Zugriff

    Detecting Distracted Drivers Using Convolutional Neural Networks

    Tarabin, Mohamad / Alketbi, Mariam Mohamed / Alfalasi, Hamad Rashed et al. | IEEE | 2023


    Mobile telephones, distracted attention, and pedestrian safety

    Nasar, Jack / Hecht, Peter / Wener, Richard | Elsevier | 2007