The invention provides a perceptual fusion object tracking system and a method thereof, and belongs to the field of object tracking, and the perceptual fusion object tracking system comprises a first fusion module and a second fusion module. The first fusion module carries out first fusion on a two-dimensional driving image and three-dimensional point cloud information to obtain first fusion information with a plurality of identification objects. The second fusion module is in signal connection with the first fusion module and carries out second fusion on the first fusion information and two-dimensional radar information so as to obtain second fusion information with the identification objects. The second fusion information is used for generating a region of interest, and the identified objects in the region of interest are used as a plurality of target objects for subsequent detection and tracking. According to the invention, the object can be stably detected and tracked.

    本发明提供了一种感知融合物件追踪系统及其方法,属于物件追踪领域,感知融合物件追踪系统包括一第一融合模块以及一第二融合模块。第一融合模块将一二维行车影像与一三维点云信息进行第一次融合,以获得具有多个辨识物件的一第一融合信息。第二融合模块信号连接第一融合模块,将第一融合信息与一二维雷达信息进行第二次融合,以获得具有这些辨识物件的一第二融合信息。第二融合信息被用于产生一感兴趣区域,以及在感兴趣区域内的这些辨识物件作为后续检测及追踪多个目标物件。本发明能够稳定地检测及追踪物件。


    Access

    Download


    Export, share and cite



    Title :

    Perceptual fusion object tracking system and method thereof


    Additional title:

    感知融合物件追踪系统及其方法


    Contributors:
    ZHANG YUNLING (author) / LIN SHIXUAN (author)

    Publication date :

    2024-01-30


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06V / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G01S RADIO DIRECTION-FINDING , Funkpeilung / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL



    Perceptual Tracking of Edge Features

    Qi Gang Gao / IEEE; Signal Processing Society | British Library Conference Proceedings | 1994


    REALTIME PROACTIVE OBJECT FUSION FOR OBJECT TRACKING

    ADAM PAUL A / FELDMAN DMITRIY / CHOI GABRIEL T et al. | European Patent Office | 2021

    Free access

    Multiple camera fusion for multi-object tracking

    Dockstader, S.L. / Tekalp, A.M. | IEEE | 2001


    Real Time Face and Object Tracking as a Component of a Perceptual User Interface

    Bradski, G. R. | British Library Conference Proceedings | 1998


    Multi-Scan Sensor Fusion for Object Tracking

    JIA BIN / WANG XIAOHUI | European Patent Office | 2023

    Free access