In complex traffic scenarios, several factors including lighting, weather, the size of the traffic participants, the distance between the traffic participants and the camera, and occlusions impact the features of the traffic participants. The impact of these factors is a huge challenge, especially for vision-based instance segmentation networks. To this end, this paper proposes an enhanced version of the RTMDet to promote the overall performance of instance segmentation in complex traffic scenarios. Firstly, an extended CSP-style backbone with large kernel convolutions of different kernel sizes is used to enhance the robustness of feature extraction capability, which contributes to obtaining more information about traffic objects of different scales. Secondly, a plugin pre-fusion module is designed to enhance the network’s robustness to multi-scale changes caused by distance changes. Additionally, instance kernel distinguish module is proposed to further highlight and distinguish different instance objects under poor lighting or weather and occlusion situations. Finally, the existing advanced image generation technology is used to expand the BDD100k dataset, enriching the dataset with severe scenarios. With an input resolution of $\mathbf {1280}\times \mathbf {720}$ on the expanded BDD100K dataset, the proposed RTMDet-R achieves an accuracy of 25.4% mAP on the instance mask and 27.8% mAP on the instance box. This surpasses other similar models in terms of accuracy. Additionally, it maintains a good inference speed of 23.1 FPS, achieving the trade-off between accuracy and speed. Code and models are released at https://github.com/GTrui6/RTMDet-R.git.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    RTMDet-R: A Robust Instance Segmentation Network for Complex Traffic Scenarios


    Contributors:
    Wang, Hai (author) / Qin, Qirui (author) / Chen, Long (author) / Li, Yicheng (author) / Cai, Yingfeng (author)


    Publication date :

    2025-06-01


    Size :

    3755239 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    RTMDet-MGG: A Multi-Task Model With Global Guidance

    Wang, Hai / Qin, Qirui / Chen, Long et al. | IEEE | 2024



    Leveraging Multimodal-LLMs Assisted by Instance Segmentation for Intelligent Traffic Monitoring

    Onsu, Murat Arda / Lohan, Poonam / Kantarci, Burak et al. | ArXiv | 2025

    Free access

    Instance Segmentation as Image Segmentation Annotation

    Watanabe, Thomio / Wolf, Denis F. | IEEE | 2019


    INSTANCE SEGMENTATION AS IMAGE SEGMENTATION ANNOTATION

    Watanabe, Thomio / Wolf, Denis F. | British Library Conference Proceedings | 2019