In complex traffic scenarios, several factors including lighting, weather, the size of the traffic participants, the distance between the traffic participants and the camera, and occlusions impact the features of the traffic participants. The impact of these factors is a huge challenge, especially for vision-based instance segmentation networks. To this end, this paper proposes an enhanced version of the RTMDet to promote the overall performance of instance segmentation in complex traffic scenarios. Firstly, an extended CSP-style backbone with large kernel convolutions of different kernel sizes is used to enhance the robustness of feature extraction capability, which contributes to obtaining more information about traffic objects of different scales. Secondly, a plugin pre-fusion module is designed to enhance the network’s robustness to multi-scale changes caused by distance changes. Additionally, instance kernel distinguish module is proposed to further highlight and distinguish different instance objects under poor lighting or weather and occlusion situations. Finally, the existing advanced image generation technology is used to expand the BDD100k dataset, enriching the dataset with severe scenarios. With an input resolution of $\mathbf {1280}\times \mathbf {720}$ on the expanded BDD100K dataset, the proposed RTMDet-R achieves an accuracy of 25.4% mAP on the instance mask and 27.8% mAP on the instance box. This surpasses other similar models in terms of accuracy. Additionally, it maintains a good inference speed of 23.1 FPS, achieving the trade-off between accuracy and speed. Code and models are released at https://github.com/GTrui6/RTMDet-R.git.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    RTMDet-R: A Robust Instance Segmentation Network for Complex Traffic Scenarios


    Beteiligte:
    Wang, Hai (Autor:in) / Qin, Qirui (Autor:in) / Chen, Long (Autor:in) / Li, Yicheng (Autor:in) / Cai, Yingfeng (Autor:in)


    Erscheinungsdatum :

    01.06.2025


    Format / Umfang :

    3755239 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    RTMDet-MGG: A Multi-Task Model With Global Guidance

    Wang, Hai / Qin, Qirui / Chen, Long et al. | IEEE | 2024


    Leveraging Multimodal-LLMs Assisted by Instance Segmentation for Intelligent Traffic Monitoring

    Onsu, Murat Arda / Lohan, Poonam / Kantarci, Burak et al. | ArXiv | 2025

    Freier Zugriff


    Instance Segmentation as Image Segmentation Annotation

    Watanabe, Thomio / Wolf, Denis F. | IEEE | 2019


    INSTANCE SEGMENTATION AS IMAGE SEGMENTATION ANNOTATION

    Watanabe, Thomio / Wolf, Denis F. | British Library Conference Proceedings | 2019