For an autonomous car, the ability to foresee a humans action is very useful for mitigating the risk of a possible collision. To humans this pedestrian intention foresight comes naturally as they are able to recognize another person's actions just by perceiving subtle changes in posture. Approximating this intention inference ability by directly training a deep neural network is useful but especially challenging. First, sufficiently large datasets for intention recognition with frame-wise human pose and intention annotations are rare and expensive to compile. Second, training on smaller datasets can lead to overfitting and make it difficult to adapt to intra-class variations in action executions. Therefore, in this paper, we propose a real time framework that learns (i) intention recognition using weak-supervision and (ii) locomotion dynamics of intention from pose information using transfer learning. This new formulation is able to tackle the lack of frame-wise annotations and to learn intra-class variation in action executions. We empirically demonstrate that our proposed approach leads to earlier and more stable detection of intention than other state of the art approaches with real time operation and the ability to detect intention one second before the pedestrian reaches the kerb.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Learning to Forecast Pedestrian Intention from Pose Dynamics


    Beteiligte:
    Ghori, Omair (Autor:in) / Mackowiak, Radek (Autor:in) / Bautista, Miguel (Autor:in) / Beuter, Niklas (Autor:in) / Drumond, Lucas (Autor:in) / Diego, Ferran (Autor:in) / Ommer, Bjorn (Autor:in)


    Erscheinungsdatum :

    01.06.2018


    Format / Umfang :

    5299198 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    LEARNING TO FORECAST PEDESTRIAN INTENTION FROM POSE DYNAMICS

    Ghori, Omair / Mackowiak, Radek / Bautista, Miguel et al. | British Library Conference Proceedings | 2018


    Pedestrian Crossing Intention Prediction at Red-Light Using Pose Estimation

    Zhang, Shile / Abdel-Aty, Mohamed / Wu, Yina et al. | IEEE | 2022



    Pedestrian Path, Pose and Intention Prediction through Gaussian Process Dynamical Models and Pedestrian Activity Recognition

    Quintero, Raul / Parra, Ignacio / Llorca, David Fernandez et al. | ArXiv | 2020

    Freier Zugriff

    Pedestrian Path, Pose, and Intention Prediction Through Gaussian Process Dynamical Models and Pedestrian Activity Recognition

    Quintero Minguez, Raul / Parra Alonso, Ignacio / Fernandez-Llorca, David et al. | IEEE | 2019