We formulate camera and LiDAR fusion tracking as a sequential decision-making process. With our deep reinforcement learning framework, we try to optimize the tracking trajectory to be as accurate, smooth, and long as possible. In contrast to traditional fusion algorithms involving complex feature and strategy design and hyperparameters tuned for different scenarios, our fusion agent can learn the confidence of each input by tracking the results from raw observation in a data-driven fashion. Given the input states of different sensors, our approach chooses one input with a higher expected cumulative reward as the observation of a Kalman filter to iteratively predict the target position. The expected cumulative reward is estimated with a convolutional neural network, trained with a modified DQN algorithm, which takes inputs from both LiDAR and a camera. Through case studies and quantitative result evaluation on our dataset from the 4th Ring Road in Beijing, our algorithm is validated to achieve more accurate and robust tracking performance.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Camera and LiDAR Fusion for On-road Vehicle Tracking with Reinforcement Learning


    Beteiligte:
    Fang, Yongkun (Autor:in) / Zhao, Huijing (Autor:in) / Zha, Hongbin (Autor:in) / Zhao, Xijun (Autor:in) / Yao, Wen (Autor:in)


    Erscheinungsdatum :

    2019-06-01


    Format / Umfang :

    2454163 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    CAMERA AND LIDAR FUSION FOR ON-ROAD VEHICLE TRACKING WITH REINFORCEMENT LEARNING

    Fang, Yongkun / Zhao, Huijing / Zha, Hongbin et al. | British Library Conference Proceedings | 2019


    Vehicle tracking with lane assignment by camera and lidar sensor fusion

    Weigel, Hendrik / Lindner, Philipp / Wanielik, Gerd | IEEE | 2009


    Vehicle Tracking with Lane Assignment by Camera and Lidar Sensor Fusion

    Weigel, H. / Lindner, P. / Wanielik, G. | British Library Conference Proceedings | 2009


    Multi-Stage Residual Fusion Network for LIDAR-Camera Road Detection

    Yu, Dameng / Xiong, Hui / Xu, Qing et al. | IEEE | 2019


    Lidar and camera data fusion for automated vehicle

    WEI JUNQING / KIM JUNSUNG / LEE JONG HO | Europäisches Patentamt | 2020

    Freier Zugriff