Segmentation of drivable roads and negative obstacles is critical to the safe driving of autonomous vehicles. Currently, many multi-modal fusion methods have been proposed to improve segmentation accuracy, such as fusing RGB and depth images. However, we find that when fusing two modals of data with untrustworthy features, the performance of multi-modal networks could be degraded, even lower than those using a single modality. In this paper, the untrustworthy features refer to those extracted from regions (e.g., far objects that are beyond the depth measurement range) with invalid depth data (i.e., 0 pixel value) in depth images. The untrustworthy features can confuse the segmentation results, and hence lead to inferior results. To provide a solution to this issue, we propose the adaptive-mask fusion Network (AMFNet) by introducing adaptive-weight masks in the fusion module to fuse features from RGB and depth images with inconsistency. In addition, we release a large-scale RGB-depth dataset with manually-labeled ground truth based on the NPO dataset for drivable roads and negative obstacles segmentation. Extensive experimental results demonstrate that our network achieves state-of-the-art performance compared with other networks. Our code and dataset are available at: https://github.com/lab-sun/AMFNet.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Adaptive-Mask Fusion Network for Segmentation of Drivable Road and Negative Obstacle With Untrustworthy Features


    Contributors:
    Feng, Zhen (author) / Feng, Yuchao (author) / Guo, Yanning (author) / Sun, Yuxiang (author)


    Publication date :

    2023-06-04


    Size :

    6664902 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    road drivable drone

    KANG JAE YOUNG | European Patent Office | 2022

    Free access

    GENERIC OBSTACLE DETECTION IN DRIVABLE AREA

    SAGGU INDERJOT | European Patent Office | 2024

    Free access

    Generic obstacle detection in drivable area

    SAGGU INDERJOT SINGH | European Patent Office | 2024

    Free access

    Generic Obstacle Detection in Drivable Area

    SAGGU INDERJOT SINGH | European Patent Office | 2024

    Free access