This paper investigates neural network architectures that fuse feature-level data of radar and vision sensors in order to improve automotive environment perception for advanced driver assistance systems. Fusion is performed with occupancy grids, which incorporate sensor-specific information mapped from their individual detection lists. The fusion step is evaluated on three types of neural networks: (1) fully convolutional, (2) auto-encoder and (3) auto-encoder with skipped connections. These networks are trained to fuse radar and camera occupancy grids with the ground truth obtained from lidar scans. A detailed analysis of network architectures and parameters is performed. Results are compared to classical Bayesian occupancy fusion on typical evaluation metrics for pixel-wise classification tasks, like intersection over union and pixel accuracy. This paper shows that it is possible to perform grid fusion of feature-level sensor data with the proposed system architecture. Especially the auto-encoder architectures show significant improvements in evaluation metrics compared to classical Bayesian fusion method.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Deep Grid Fusion of Feature-Level Sensor Data with Convolutional Neural Networks


    Beteiligte:
    Balazs, Gabor (Autor:in) / Stechele, Walter (Autor:in)


    Erscheinungsdatum :

    2019-11-01


    Format / Umfang :

    1285476 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Feature-level sensor fusion

    Peli, T. Young, M. Knox, R. Ellis, K. K. | British Library Conference Proceedings | 1999


    Feature Cloning and Feature Fusion Based Transportation Mode Detection Using Convolutional Neural Network

    Alam, Md. Golam Rabiul / Haque, Mahmudul / Hassan, Md. Rafiul et al. | IEEE | 2023


    Feature-Based Satellite Detection Using Convolutional Neural Networks

    Fletcher, Justin | British Library Conference Proceedings | 2019


    Automated Vehicle Recognition with Deep Convolutional Neural Networks

    Adu-Gyamfi, Yaw Okyere / Asare, Sampson Kwasi / Sharma, Anuj et al. | Transportation Research Record | 2017


    Deep Spatial–Temporal 3D Convolutional Neural Networks for Traffic Data Forecasting

    Guo, Shengnan / Lin, Youfang / Li, Shijie et al. | IEEE | 2019