Action understanding is a fundamental computer vision branch for several applications, ranging from surveillance to robotics. Most works deal with localizing and recognizing the action in both time and space, without providing a characterization of its evolution. Recent works have addressed the prediction of action progress, which is an estimate of how far the action has advanced as it is performed. In this paper, we propose to predict action progress using a different modality compared to previous methods: body joints. Human body joints carry very precise information about human poses, which we believe are a much more lightweight and effective way of characterizing actions and therefore their execution. Estimating action progress can in fact be determined based on the understanding of how key poses follow each other during the development of an activity. We show how an action progress prediction model can exploit body joints and integrate it with modules providing keypoint and action information in order to be run directly from raw pixels. The proposed method is experimentally validated on the Penn Action Dataset.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Joint-Based Action Progress Prediction



    Erscheinungsdatum :

    2023-01-01



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    SAN: Scene Anchor Networks for Joint Action-Space Prediction

    Janjos, Faris / Dolgov, Maxim / Kuric, Muhamed et al. | IEEE | 2022


    ACTION PREDICTION DEVICE, ACTION PREDICTION METHOD AND PROGRAM

    YAMAGUCHI TERUYA / DAIMON MAKOTO / OHAMA YOSHIKO | Europäisches Patentamt | 2020

    Freier Zugriff

    PACE: Joint Society Action

    Kostek | Online Contents | 1996


    PEDESTRIAN ACTION PREDICTION DEVICE AND PEDESTRIAN ACTION PREDICTION METHOD

    KINDO TOSHIKI / OGAWA MASAHIRO / FUNAYAMA RYUJI | Europäisches Patentamt | 2018

    Freier Zugriff

    Progress in rail joint construction

    Cram, R.C. | Engineering Index Backfile | 1920