A computer-implemented method is provided for action localization. The method includes converting one or more video frames into person keypoints and object keypoints. The method further includes embedding position, timestamp, instance, and type information with the person keypoints and object keypoints to obtain keypoint embeddings. The method also includes predicting, by a hierarchical transformer encoder using the keypoint embeddings, human actions and bounding box information of when and where the human actions occur in the one or more video frames.


    Access

    Download


    Export, share and cite



    Title :

    KEYPOINT BASED ACTION LOCALIZATION


    Contributors:
    KADAV ASIM (author) / LAI FARLEY (author) / GRAF HANS PETER (author) / HUANG YI (author)

    Publication date :

    2022-07-28


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06V / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Keypoint based action localization

    KADAV ASIM / LAI FARLEY / GRAF HANS PETER et al. | European Patent Office | 2025

    Free access


    Hierarchical Visual Localization Based on Sparse Feature Pyramid for Adaptive Reduction of Keypoint Map Size

    Potapov, Andrei / Kurenkov, Mikhail / Karpyshev, Pavel et al. | IEEE | 2023


    KEYPOINT TRAJECTORY ESTIMATION USING PROPAGATION BASED TRACKING

    Fanani, Nolang / Ochs, Matthias / Bradler, Henry et al. | British Library Conference Proceedings | 2016


    Performance Evaluation of 3D Keypoint Detectors

    Tombari, F. / Salti, S. / Di Stefano, L. | British Library Online Contents | 2013