A system and method are provided for driving assistance. The system includes an image capture device configured to capture an actual image relative to an outward view from a motor vehicle and depicting an object. The system further includes a processor configured to render, based on a set of 3D CAD models, synthetic images with corresponding intermediate shape concept labels. The processor is further configured to form a multi-layer CNN which jointly models multiple intermediate shape concepts, based on the rendered synthetic images. The processor is also configured to perform an intra-class appearance variation-aware and occlusion-aware 3D object parsing on the actual image by applying the CNN to the actual image to output an image pair including a 2D and 3D geometric structure of the object. The processor is additionally configured to perform an action to mitigate a likelihood of harm involving the motor vehicle, based on the image pair.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Advanced driver-assistance system with landmark localization on objects in images using convolutional neural networks


    Beteiligte:
    ZIA MUHAMMAD ZEESHAN (Autor:in) / TRAN QUOC-HUY (Autor:in) / YU XIANG (Autor:in) / CHANDRAKER MANMOHAN (Autor:in) / LI CHI (Autor:in)

    Erscheinungsdatum :

    2019-05-14


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    IPC:    G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G06V / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen



    ADVANCED DRIVER-ASSISTANCE SYSTEM WITH LANDMARK LOCALIZATION ON OBJECTS IN IMAGES USING CONVOLUTIONAL NEURAL NETWORKS

    ZIA MUHAMMAD ZEESHAN / TRAN QUOC-HUY / YU XIANG et al. | Europäisches Patentamt | 2018

    Freier Zugriff

    Landmark localization on objects in images using convolutional neural networks

    ZIA MUHAMMAD ZEESHAN / TRAN QUOC-HUY / YU XIANG et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    Surveillance system with landmark localization on objects in images using convolutional neural networks

    ZIA MUHAMMAD ZEESHAN / TRAN QUOC-HUY / YU XIANG et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    Action recognition system with landmark localization on objects in images using convolutional neural networks

    ZIA MUHAMMAD ZEESHAN / TRAN QUOC-HUY / YU XIANG et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    DeepLocalization: Landmark-based Self-Localization with Deep Neural Networks

    Engel, Nico / Hoermann, Stefan / Horn, Markus et al. | IEEE | 2019