Driver irregular operations have long been recognized as the main contributing factors in traffic accidents. Therefore, early and accurate identification of driver actions can help mitigate the effects of potentially unsafe driving behaviors and avoid possible accidents. This paper studies skeletonbased driver action recognition using spatial-temporal graph and genetically-weighted algorithm. We first determine the body pose of the driver by selectively sampling the informative frames in a video, which includes driver joints with high confidence scores and joints position coordinate obtained in pose estimation algorithm. Afterward, we use the skeleton-based graph in the spatial-temporal domains to estimate driver’s joints position, and these dynamic skeletons of the captured poses are used as inputs to the Graph Convolutional Networks (GCNs). Finally, the genetically-weighted algorithm is used to vote for the joint point with the highest score of association and significant position change, and we adopt the correlation between the sensory input and the impending driver behavior to determine the driver’s detailed actions. We experiment in the Kinetics, NTURGB+D and StateFarm datasets. The results show that our method has high accuracy and strong generalization capability.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Novel Spatial-Temporal Graph for Skeleton-based Driver Action Recognition


    Beteiligte:
    Li, Peng (Autor:in) / Lu, Meiqi (Autor:in) / Zhang, Zhiwei (Autor:in) / Shan, Donghui (Autor:in) / Yang, Yang (Autor:in)


    Erscheinungsdatum :

    2019-10-01


    Format / Umfang :

    2873564 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Driver-Skeleton: A Dataset for Driver Action Recognition

    Lin, Zeyang / Liu, Yinchuan / Zhang, Xuetao | IEEE | 2021


    Skeleton driven action recognition using an image-based spatial-temporal representation and convolution neural network

    Silva, Vinícius / Soares, Filomena / Leão, Celina Pinto et al. | BASE | 2021

    Freier Zugriff

    Driver activity recognition using spatial‐temporal graph convolutional LSTM networks with attention mechanism

    Pan, Chaopeng / Cao, Haotian / Zhang, Weiwei et al. | Wiley | 2021

    Freier Zugriff

    Driver activity recognition using spatial‐temporal graph convolutional LSTM networks with attention mechanism

    Chaopeng Pan / Haotian Cao / Weiwei Zhang et al. | DOAJ | 2021

    Freier Zugriff