A method of multi-sensor data fusion using deep learning is proposed for the autonomous driving system. First, the realtime road condition information is collected through the binocular camera mounted on the car model, and the road and the obstacles on the road are identified with the semantic segmentation of the deep neural network image. At the same time, supplemented with other information collected by the laser sensor and ultrasonic sensor on the car model, as well as the road information obtained by Beidou navigation, the Kalman filter parameters are optimized with deep learning and passed via algorithm fusion to the car model actuator for automatic operation. The signals collected by multiple groups of the same type of sensors on the car model are optimized by an improved Kalman filter algorithm to achieve fast and accurate output of real-time results. The actual vehicle experiment results of the smart car model show that the solution can realize tasks such as autonomous navigation and driving, automatic obstacle avoidance, automatic route planning and prediction in a variety of complex road environments, with an operating speed equivalent to 80 km/h and a safety rate of 99.8%.


    Zugriff

    Zugriff über TIB

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Design and Application of Autonomous Driving System based on Multi-sensor Fusion


    Beteiligte:
    Xie, Jingwei (Autor:in) / Li, Dan (Autor:in)

    Kongress:

    ICMLCA 2021 - 2nd International Conference on Machine Learning and Computer Application ; 2021 ; Shenyang, China


    Erschienen in:

    Erscheinungsdatum :

    01.01.2022


    Format / Umfang :

    6 pages



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Multi-sensor fusion for autonomous driving

    Zhang, Xinyu / Li, Jun / Li, Zhiwei et al. | TIBKAT | 2023


    Research on the Application of Multi-Sensor Fusion in Autonomous Driving

    Li, Wu / Xie, Zongzhi / He, Pengfei | IEEE | 2025


    Autonomous driving trolley device based on multi-sensor fusion slam

    ZHONG HONGLONG / JIANG HONG / ZHANG XIANGFENG et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Multi-sensor fusion 3D object detection for autonomous driving

    Alaba, Simegnew Yihunie / Ball, John E. | British Library Conference Proceedings | 2023


    Demo: Attacking Multi-Sensor Fusion based Localization in High-Level Autonomous Driving

    Shen, Junjie / Won, Jun Yeon / Chen, Zeyuan et al. | TIBKAT | 2021