Methods and systems for processing image data utilising Deep Neural Networks (DNNs) are disclosed. The method comprises receiving image data collected by one or more sensors mounted in a mobility device, such as a robot, unmanned automobile or unmanned aerial vehicle (UAV). The DNN extracts topological information from the image data and generates a tree-like graph based on said pictures (Fig. 2). The images may consist of optical, infrared, lidar, radar, depth or sonar data, and information from a structured light sensor. The geographical information may comprise feature maps generated by at least one layer of the DNN. The topological information may represent semantic categories of potential trajectories. The dendritic graph generation can include identifying the current position of the mobility device as a parent node, from which candidate child nodes are expanded, iterating the procedure (Fig.4). The DNN may be trained by using a loss function, comparing a predicted graph with ground truth data. The mobility device may navigate utilising the tree-like graph.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Method and system for processing image data utilizing deep neural network


    Beteiligte:

    Erscheinungsdatum :

    2020-05-27


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    IPC:    G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / B63G OFFENSIVE OR DEFENSIVE ARRANGEMENTS ON VESSELS , Angriffs- oder Verteidigungsanordnungen auf Schiffen / G01C Messen von Entfernungen, Höhen, Neigungen oder Richtungen , MEASURING DISTANCES, LEVELS OR BEARINGS / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    NEURAL NETWORK IMAGE PROCESSING

    LITVAK ARTEM / ZHANG XIANLING / JAIPURIA NIKITA et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Neural network image processing

    LITVAK ARTEM / ZHANG XIANLING / JAIPURIA NIKITA et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Image signal processor, image processing device and neural network image processing system

    ZHU HONGLEI / ZENG WANWEI / SHANG QUAN | Europäisches Patentamt | 2020

    Freier Zugriff

    Image processing using evolutive neural network

    Chernyavsky, Alexander V. / Spitsyn, Vladimir G. / Tsoy, Yuri R. | SPIE | 2006