As the field of self-driving cars accelerates, the accurate interpretation of traffic officers' signals has become a pivotal technological advancement. Current research has explored various feature representation-based methods for traffic police gesture recognition, including RGB frames, optical flow, human skeletons, and point clouds. However, the existing methods still face challenges in spatio-temporal information fusion and feature extraction. Specifically, the skeletonbased method, noted for its focus on actions and compactness, could benefit from improvements in processing speed and robustness. In response to these challenges, the present study proposes a SlowFast network-based approach for traffic police gesture recognition (SF-TPGR). The method uses 3D heatmaps as inputs to convey the relative positional information of joint points through heatmap intensity changes, thereby improving model accuracy and speed by reducing the redundancy of heatmaps for lower limb joints. The SlowFast network architecture is then used for traffic police gesture recognition, effectively modeling rapidly changing actions such as going straight and lane changing with high frame refresh rates. The comparative experiment conducted on the Chinese traffic police gesture dataset shows that the accuracy of this method reaches 98.10%, and the inference time is reduced to 79 ms. Although its accuracy may be slightly lower than some top-performing methods in certain cases, its capability to rapidly extract human movements is a significant advantage.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Traffic police gesture recognition based on SlowFast network


    Contributors:
    Yin, Minghao (editor) / Zhang, Xin (editor) / Zhu, Xinting (author) / Fang, Ming (author)

    Conference:

    Fifth International Conference on Computer Vision and Data Mining (ICCVDM 2024) ; 2024 ; Changchun, China


    Published in:

    Proc. SPIE ; 13272


    Publication date :

    2024-10-03





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Traffic police gesture recognition and judgment based on Openpose

    Zhu, Qingxiang / Dang, Xueming | SPIE | 2024


    Traffic Police Gesture Recognition Based on Openpose and GRU

    Wang, Dengwen / Wang, Wangmeng / Chen, Yanbing et al. | IEEE | 2022


    Traffic Police Gesture Recognition by Pose Graph Convolutional Networks

    Fang, Zhijie / Zhang, Wuqiang / Guo, Zijie et al. | IEEE | 2020


    TRAFFIC POLICE GESTURE RECOGNITION BY POSE GRAPH CONVOLUTIONAL NETWORKS

    Fang, Zhijie / Zhang, Wuqiang / Guo, Zijie et al. | British Library Conference Proceedings | 2020