In this paper, we propose the concept of global guidance, design a global guidance structure based on a dual-scale global feature enhancement module, and construct a multi-task network (RTMDet-MGG) for road scene instance segmentation and drivable area segmentation in order to overcome the limitation of current multi-task networks in sharing features to different task branches. The proposed global guidance structure enhances the connection between different task branches in the multi-task network by sharing the enhanced global feature with different task branches through various fusion methods, thereby enhancing the multi-task network’s overall performance. With an input resolution of $\mathbf {640}\times \mathbf {360}$ on the BDD100K dataset, RTMDet-MGG achieves an accuracy of 18.7% mAP (mean average precision) on the instance mask and 82.9% mIoU (mean intersection over union) on the drivable area, with an inference speed of 32.1 FPS (frames per second), which satisfies the requirements of real-time tasks. In addition, the algorithm has excellent scene generalization capabilities, and the mIoU of drivable area segmentation on our custom-built dataset for unstructured road drivable area segmentation reaches 93.3%.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    RTMDet-MGG: A Multi-Task Model With Global Guidance


    Contributors:
    Wang, Hai (author) / Qin, Qirui (author) / Chen, Long (author) / Li, Yicheng (author) / Cai, Yingfeng (author)

    Published in:

    Publication date :

    2024-11-01


    Size :

    2401885 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    RTMDet-R: A Robust Instance Segmentation Network for Complex Traffic Scenarios

    Wang, Hai / Qin, Qirui / Chen, Long et al. | IEEE | 2025


    TASK EXECUTION METHOD FOR MULTI-TASK ROBOTS BASED ON GUIDANCE OF MULTI-GUIDANCE ROBOTS

    SHI CONGLING / CHE HONGLEI / LIU GUOLIN et al. | European Patent Office | 2024

    Free access


    Multi-Hypothesis Guidance with Interacting Multiple Model Filter

    Schneider, Marc / Fichter, Walter | TIBKAT | 2022


    Multi-Hypothesis Guidance With Interacting Multiple Model Filter

    Schneider, Marc / Fichter, Walter | AIAA | 2022