Forward obstacles detection is one of the key tasks in the perception system of autonomous vehicles. The perception solution differs from the sensors and the detection algorithm, and the vision-based approaches are always popular. In this paper, an embedding fast obstacles detection algorithm is proposed to efficiently detect forward diverse obstacles from the image stream captured by the monocular camera. Specifically, our algorithm contains three components. The first component is an object detection method using convolution neural networks (CNN) for single image. We design a detection network based on shallow residual network, and an adaptive object aspect ratio setting method for training dataset is proposed to improve the accuracy of detection. The second component is a multiple object tracking method based on correlation filter for the adjacent images. Based on precise detection result, we use multiple correlation filters to track multiple objects in every adjacent frame, and a multi-scale tracking region algorithm is applied to improve the tracking accuracy at the same time. The third component is fusing the detection method and tracking method based on parallel processing, which can significantly increase the average processing rate for the image stream or video in embedded platform. Besides, our algorithm is tested on KITTI dataset as well as our own dataset, and the experimental results illustrate that our algorithm has high precision and robustness. Meanwhile, we test our algorithm on a popular embedded platform - NVIDIA Jetson TX1, and the average processing rate is approximately 17 fps, which satisfies the high processing speed requirements of autonomous vehicles.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Embedding CNN-Based Fast Obstacles Detection for Autonomous Vehicles


    Additional title:

    Sae Technical Papers


    Contributors:
    Lei, Ao (author) / Hu, Chaowei (author) / Yu, Guizhen (author) / Wang, Yunpeng (author) / Wang, Zhangyu (author) / Hu, Zhehua (author)

    Conference:

    Intelligent and Connected Vehicles Symposium ; 2018



    Publication date :

    2018-08-07




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Embedding CNN-Based Fast Obstacles Detection for Autonomous Vehicles

    Hu, Chaowei / Wang, Yunpeng / Yu, Guizhen et al. | British Library Conference Proceedings | 2018


    Obstacles detection for autonomous vehicles

    Fernandez-Maloigne,C. / Boscolo,C. / Claisse,H. et al. | Automotive engineering | 1993


    93AT130 Obstacles Detection for Autonomous Vehicles

    Fernandez-Maloigne, C. / Boscolo, C. / Claisse, H. et al. | British Library Conference Proceedings | 1993



    GROUP AND COMBINE OBSTACLES FOR AUTONOMOUS DRIVING VEHICLES

    TAO JIAMING / LUO QI / ZHOU JINYUN et al. | European Patent Office | 2021

    Free access