A method for semantic keypoint detection is described. The method includes linking, using a keypoint graph neural network (KGNN), semantic keypoints of an object within a first image of a video stream into a 2D graph structure corresponding to a category of the object. The method also includes embedding descriptors within the semantic keypoints of the 2D graph structure corresponding to the category of the object. The method further includes tracking the object within subsequent images of the video stream using the embedded descriptors within the semantic keypoints of the 2D graph structure corresponding to the category of the object.


    Access

    Download


    Export, share and cite



    Title :

    END-TO-END MONOCULAR 2D SEMANTIC KEYPOINT DETECTOR AND TRACKER LEARNING


    Contributors:

    Publication date :

    2022-08-04


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06K Erkennen von Daten , RECOGNITION OF DATA / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    MONOCULAR 2D SEMANTIC KEYPOINT DETECTION AND TRACKING

    CHEN HAOFENG / ARJUN BHARGAVA / RARES ANDREI AMBRUS et al. | European Patent Office | 2023

    Free access

    Self-supervised 3D keypoint learning for monocular visual odometry

    TANG JIEXIONG / AMBRUS RARES A / GUIZILINI VITOR et al. | European Patent Office | 2024

    Free access

    SELF-SUPERVISED 3D KEYPOINT LEARNING FOR MONOCULAR VISUAL ODOMETRY

    TANG JIEXIONG / AMBRUS RARES A / GUIZILINI VITOR et al. | European Patent Office | 2021

    Free access

    OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association

    Kreiss, Sven / Bertoni, Lorenzo / Alahi, Alexandre | IEEE | 2022


    Multiframe detector/tracker: optimal performance

    Bruno, M.G.S. / Moura, J.M.F. | IEEE | 2001