An action recognition system and method are provided. The action recognition system includes an image capture device configured to capture an actual image depicting an object. The action recognition system includes a processor configured to render, based on a set of 3D CAD models, synthetic images with corresponding intermediate shape concept labels. The processor is configured to form a multi-layer CNN which jointly models multiple intermediate shape concepts, based on the rendered synthetic images. The processor is configured to perform an intra-class appearance variation-aware and occlusion-aware 3D object parsing on the actual image by applying the CNN thereto to generate an image pair including a 2D and 3D geometric structure of the object. The processor is configured to control a device to perform a response action in response to an identification of an action performed by the object, wherein the identification of the action is based on the image pair.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Action recognition system with landmark localization on objects in images using convolutional neural networks


    Beteiligte:
    ZIA MUHAMMAD ZEESHAN (Autor:in) / TRAN QUOC-HUY (Autor:in) / YU XIANG (Autor:in) / CHANDRAKER MANMOHAN (Autor:in) / LI CHI (Autor:in)

    Erscheinungsdatum :

    2019-06-25


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G06V / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Landmark localization on objects in images using convolutional neural networks

    ZIA MUHAMMAD ZEESHAN / TRAN QUOC-HUY / YU XIANG et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    Surveillance system with landmark localization on objects in images using convolutional neural networks

    ZIA MUHAMMAD ZEESHAN / TRAN QUOC-HUY / YU XIANG et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    ADVANCED DRIVER-ASSISTANCE SYSTEM WITH LANDMARK LOCALIZATION ON OBJECTS IN IMAGES USING CONVOLUTIONAL NEURAL NETWORKS

    ZIA MUHAMMAD ZEESHAN / TRAN QUOC-HUY / YU XIANG et al. | Europäisches Patentamt | 2018

    Freier Zugriff

    Advanced driver-assistance system with landmark localization on objects in images using convolutional neural networks

    ZIA MUHAMMAD ZEESHAN / TRAN QUOC-HUY / YU XIANG et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    DeepLocalization: Landmark-based Self-Localization with Deep Neural Networks

    Engel, Nico / Hoermann, Stefan / Horn, Markus et al. | IEEE | 2019