Understanding pedestrian behaviors is significant for safe interaction between autonomous vehicles and pedestrians. Though numerous achievements have been reached for autonomous driving, this is still an open issue due to the highly uncertainty and dynamicity of pedestrians. Early studies treated pedestrians as moving rigid objects, predicting their future positions by trajectory prediction. More recent studies attempted to recognize pedestrian intentions by their body pose and actions. However, the intention of pedestrians is simply recognized as a binary result, cross or not-cross. This is not sufficient to describe the dynamic communication process between pedestrians and vehicles. We argue that pedestrian behaviors should be further explored and interpreted instead of concluding whether or not to cross, especially when pedestrians use hand gesture to communicate with vehicles. Hence, we established a taxonomy of pedestrian interactive behaviors. A new large-scale dataset, involving nine types of behaviors and 3600 video clips, is published. We adopted pose estimation to obtain 2D key points on pedestrian skeleton. A covariance descriptor is applied to depict high-level spatio-temporal features based on body pose, which is independent of sequence length and robust to missing key points. Then pedestrian behaviors are interpreted using Random Forest. Experiments both on the proposed dataset and publicly available JAAD dataset proved that the proposed method outperformed the state-of-the-art by approximately 5%.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Pedestrian Behavior Interpretation from Pose Estimation


    Beteiligte:
    Yang, Jun (Autor:in) / Gui, Along (Autor:in) / Wang, Jiahao (Autor:in) / Ma, Jun (Autor:in)


    Erscheinungsdatum :

    19.09.2021


    Format / Umfang :

    1102454 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Pedestrian Motion State Estimation From 2D Pose

    Li, Fei / Fan, Shiwei / Chen, Pengzhen et al. | IEEE | 2020


    PEDESTRIAN MOTION STATE ESTIMATION FROM 2D POSE

    Li, Fei / Fan, Shiwei / Chen, Pengzhen et al. | British Library Conference Proceedings | 2020


    Pedestrian Pose Estimation for Campus Unmanned Delivery Vehicles

    Jiang, Yuzhu / Li, Ying / Yang, Chao et al. | IEEE | 2023


    Pedestrian Graph: Pedestrian Crossing Prediction Based on 2D Pose Estimation and Graph Convolutional Networks

    Cadena, Pablo Rodrigo Gantier / Yang, Ming / Qian, Yeqiang et al. | IEEE | 2019


    Video-based pedestrian head pose estimation for risk assessment

    Schulz, Andreas / Stiefelhagen, Rainer | IEEE | 2012