Driver irregular operations have long been recognized as the main contributing factors in traffic accidents. Therefore, early and accurate identification of driver actions can help mitigate the effects of potentially unsafe driving behaviors and avoid possible accidents. This paper studies skeletonbased driver action recognition using spatial-temporal graph and genetically-weighted algorithm. We first determine the body pose of the driver by selectively sampling the informative frames in a video, which includes driver joints with high confidence scores and joints position coordinate obtained in pose estimation algorithm. Afterward, we use the skeleton-based graph in the spatial-temporal domains to estimate driver’s joints position, and these dynamic skeletons of the captured poses are used as inputs to the Graph Convolutional Networks (GCNs). Finally, the genetically-weighted algorithm is used to vote for the joint point with the highest score of association and significant position change, and we adopt the correlation between the sensory input and the impending driver behavior to determine the driver’s detailed actions. We experiment in the Kinetics, NTURGB+D and StateFarm datasets. The results show that our method has high accuracy and strong generalization capability.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Novel Spatial-Temporal Graph for Skeleton-based Driver Action Recognition


    Contributors:
    Li, Peng (author) / Lu, Meiqi (author) / Zhang, Zhiwei (author) / Shan, Donghui (author) / Yang, Yang (author)


    Publication date :

    2019-10-01


    Size :

    2873564 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Driver-Skeleton: A Dataset for Driver Action Recognition

    Lin, Zeyang / Liu, Yinchuan / Zhang, Xuetao | IEEE | 2021


    Skeleton driven action recognition using an image-based spatial-temporal representation and convolution neural network

    Silva, Vinícius / Soares, Filomena / Leão, Celina Pinto et al. | BASE | 2021

    Free access

    Driver activity recognition using spatial‐temporal graph convolutional LSTM networks with attention mechanism

    Pan, Chaopeng / Cao, Haotian / Zhang, Weiwei et al. | Wiley | 2021

    Free access


    3D Skeleton-Based Driver Activity Recognition Using Self-Supervised Learning

    Lerch, David J. / El Bachiri, Yasser / Martin, Manuel et al. | IEEE | 2024