A computer-implemented method is provided for action localization. The method includes converting one or more video frames into person keypoints and object keypoints. The method further includes embedding position, timestamp, instance, and type information with the person keypoints and object keypoints to obtain keypoint embeddings. The method also includes predicting, by a hierarchical transformer encoder using the keypoint embeddings, human actions and bounding box information of when and where the human actions occur in the one or more video frames.


    Access

    Download


    Export, share and cite



    Title :

    KEYPOINT BASED ACTION LOCALIZATION


    Contributors:
    KADAV ASIM (author) / LAI FARLEY (author) / GRAF HANS PETER (author) / HUANG YI (author)

    Publication date :

    2022-07-28


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06V / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Hierarchical Visual Localization Based on Sparse Feature Pyramid for Adaptive Reduction of Keypoint Map Size

    Potapov, Andrei / Kurenkov, Mikhail / Karpyshev, Pavel et al. | IEEE | 2023


    Performance Evaluation of 3D Keypoint Detectors

    Tombari, F. / Salti, S. / Di Stefano, L. | British Library Online Contents | 2013


    Visual Object Categorization with New Keypoint-based AdaBoost Features

    Bdiri, T. / Moutarde, F. / Steux, B. | British Library Conference Proceedings | 2009


    Visual object categorization with new keypoint-based adaBoost features

    Bdiri, Taoufik / Moutarde, Fabien / Steux, Bruno | IEEE | 2009


    Keypoint descriptor matching with context-based orientation estimation

    Bellavia, F. / Tegolo, D. / Valenti, C. | British Library Online Contents | 2014