A computer-implemented method is provided for action localization. The method includes converting one or more video frames into person keypoints and object keypoints. The method further includes embedding position, timestamp, instance, and type information with the person keypoints and object keypoints to obtain keypoint embeddings. The method also includes predicting, by a hierarchical transformer encoder using the keypoint embeddings, human actions and bounding box information of when and where the human actions occur in the one or more video frames.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    KEYPOINT BASED ACTION LOCALIZATION


    Beteiligte:
    KADAV ASIM (Autor:in) / LAI FARLEY (Autor:in) / GRAF HANS PETER (Autor:in) / HUANG YI (Autor:in)

    Erscheinungsdatum :

    28.07.2022


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    IPC:    G06V / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Keypoint based action localization

    KADAV ASIM / LAI FARLEY / GRAF HANS PETER et al. | Europäisches Patentamt | 2025

    Freier Zugriff


    Hierarchical Visual Localization Based on Sparse Feature Pyramid for Adaptive Reduction of Keypoint Map Size

    Potapov, Andrei / Kurenkov, Mikhail / Karpyshev, Pavel et al. | IEEE | 2023


    KEYPOINT TRAJECTORY ESTIMATION USING PROPAGATION BASED TRACKING

    Fanani, Nolang / Ochs, Matthias / Bradler, Henry et al. | British Library Conference Proceedings | 2016


    Performance Evaluation of 3D Keypoint Detectors

    Tombari, F. / Salti, S. / Di Stefano, L. | British Library Online Contents | 2013