Monocular cameras are one of the most commonly used sensors in the automotive industry for autonomous vehicles. One major drawback using a monocular camera is that it only makes observations in the two dimensional image plane and can not directly measure the distance to objects. In this paper, we aim at filling this gap by developing a multi-object tracking algorithm that takes an image as input and produces trajectories of detected objects in a world coordinate system. We solve this by using a deep neural network trained to detect and estimate the distance to objects from a single input image. The detections from a sequence of images are fed in to a state-of-the art Poisson multi-Bernoulli mixture tracking filter. The combination of the learned detector and the PMBM filter results in an algorithm that achieves 3D tracking using only mono-camera images as input. The performance of the algorithm is evaluated both in 3D world coordinates, and 2D image coordinates, using the publicly available KITTI object tracking dataset. The algorithm shows the ability to accurately track objects, correctly handle data associations, even when there is a big overlap of the objects in the image, and is one of the top performing algorithms on the KITTI object tracking benchmark. Furthermore, the algorithm is efficient, running on average close to 20 frames per second.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Mono-Camera 3D Multi-Object Tracking Using Deep Learning Detections and PMBM Filtering


    Beteiligte:


    Erscheinungsdatum :

    01.06.2018


    Format / Umfang :

    2744135 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    MONO-CAMERA 3D MULTI-OBJECT TRACKING USING DEEP LEARNING DETECTIONS AND PMBM FILTERING

    Scheidegger, Samuel / Benjaminsson, Joachim / Rosenberg, Emil et al. | British Library Conference Proceedings | 2018


    PMBM-Based Unresolved-Group Object Tracking

    Li, Guchong / Li, Gang / He, You | IEEE | 2024


    Accurate object proposals by tracking detections

    SCHULTER SAMUEL / CHOI WONGUN / SINGH BHARAT et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    Field-weakening Control of PMBM Based on Instantaneous Power Theory

    Zhang, Zhouyun / Gun, Jun / Wei, Shi et al. | IEEE | 2006


    Action recognition using accurate object proposals by tracking detections

    SCHULTER SAMUEL / CHOI WONGUN / SINGH BHARAT et al. | Europäisches Patentamt | 2019

    Freier Zugriff