Effective semantic segmentation of lane marking is crucial for construction of high-precision lane level maps. In recent years, a number of different methods for semantic segmentation of images have been proposed. These methods concentrate mainly on analysis of camera images, due to limitations with the sensor itself, and thus far, the accurate three-dimensional spatial position of the lane marking could not be obtained, which hinders lane level map construction.This article proposes a lane marking semantic segmentation method based on LIDAR and camera image fusion using a deep neural network. In the approach, the object of the semantic segmentation is a bird’s-eye view converted from a LIDAR points cloud instead of an image captured by a camera. First, the DeepLabV3+ network image segmentation method is used to segment the image captured by the camera, and the segmentation result is then merged with the point clouds collected by the LIDAR as the input of the proposed network. A long short-term memory (LSTM) structure is added to the neural network to assist the network in semantic segmentation of lane markings by enabling use of time series information. Experiments on datasets containing more than 14,000 images, which were manually labeled and expanded, showed that the proposed method provides accurate semantic segmentation of the bird’s-eye view LIDAR points cloud. Consequently, automation of high-precision map construction can be significantly improved. Our code is available at https://github.com/rolandying/FusionLane.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    FusionLane: Multi-Sensor Fusion for Lane Marking Semantic Segmentation Using Deep Neural Networks


    Beteiligte:
    Yin, Ruochen (Autor:in) / Cheng, Yong (Autor:in) / Wu, Huapeng (Autor:in) / Song, Yuntao (Autor:in) / Yu, Biao (Autor:in) / Niu, Runxin (Autor:in)


    Erscheinungsdatum :

    01.02.2022


    Format / Umfang :

    3120033 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Deep Sensor Fusion with Pyramid Fusion Networks for 3D Semantic Segmentation

    Schieber, Hannah / Duerr, Fabian / Schoen, Torsten et al. | IEEE | 2022


    Sensor fusion: lane marking detection and autonomous intelligent cruise control system

    Baret, Marc / Baillarin, S. / Calesse, C. et al. | SPIE | 1995


    Deep Learning-Based Lane Marking Detection using A2-LMDet

    Lin, Chunmian / Li, Lin / Cai, Zhixing et al. | Transportation Research Record | 2020


    LANE MARKING DETECTION SYSTEM AND LANE MARKING DETECTION METHOD

    TAKEMAE KASHU | Europäisches Patentamt | 2015

    Freier Zugriff

    Sensor fusion: lane marking detection and autonomous intelligent cruise control system [2592-19]

    Baret, M. / Baillarin, S. / Calesse, C. et al. | British Library Conference Proceedings | 1995