Bird-eye-view (BEV) perception for autonomous driving has become popular in recent years. Among various BEV perception tasks, moving-obstacle segmentation is very important, since it can provide necessary information for downstream tasks, such as motion planning and decision making, in dynamic traffic environments. Many existing methods segment moving obstacles with LiDAR point clouds. The point-wise segmentation results can be easily projected into BEV since point clouds are 3-D data. However, these methods could not produce dense 2-D BEV segmentation maps, because LiDAR point clouds are usually sparse. Moreover, 3-D LiDARs are still expensive to vehicles. To provide a solution to these issues, this paper proposes a semantics-assisted moving-obstacle segmentation network using only low-cost visual cameras to produce segmentation results in dense 2-D BEV maps. Our network takes as input visual images from six surrounding cameras as well as the corresponding semantic segmentation maps at the current and previous moments, and directly outputs the BEV map for the current moment. We also propose a movable-obstacle segmentation auxiliary task to provide semantic information to further benefit moving-obstacle segmentation. Extensive experimental results on the public nuScenes and Lyft datasets demonstrate the effectiveness and superiority of our network.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Semantic-MoSeg: Semantics-Assisted Moving-Obstacle Segmentation in Bird-Eye-View for Autonomous Driving


    Contributors:
    Meng, Shiyu (author) / Sun, Yuxiang (author)


    Publication date :

    2025-07-01


    Size :

    5260696 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Forecasting Semantic Bird-Eye-View Maps for Autonomous Driving

    Gao, Shuang / Wang, Qiang / Navarro-Alarcon, David et al. | IEEE | 2024


    AUTONOMOUS DRIVING SCENARIO OBSTACLE PREDICTION

    HUANG KAINING / KUANG RUIFENG / XIA FEI et al. | European Patent Office | 2025

    Free access


    Automated Evaluation of Semantic Segmentation Robustness for Autonomous Driving

    Zhou, Wei / Berrio, Julie Stephany / Worrall, Stewart et al. | IEEE | 2020