Visual-based methods for rail surface defect inspection (RSDI) effectively improve the limitations of manual inspection, as they can intuitively display the locations and segmented areas of sensitive defects. The RGB-D RSDI task, which leverages the complementarity between RGB and depth (D) image information to enhance detection performance, has attracted widespread attention and achieved significant development. However, existing methods primarily depend on fully supervised training strategies that necessitate a substantial number of manually annotated pixel-level labels to supervise model training. Undoubtedly, extensive manual annotation is exceedingly time-consuming and labor-intensive, particularly considering the irregular shapes and textures of surface defects on rails, further compounding the burden of manual labeling. Therefore, in this paper, we aim to introduce the semi-supervised learning paradigm into this task. Towards the semi-supervised RGB-D RSDI task, a specific semi-supervised network for this task and an effective cross-modal fusion module are crucial to ensuring detection performance under the constraints of limited labeled samples. Thus, we propose a Depth-assisted Semi-Supervised RGB-D RSDI network (DSSNet) to simultaneously alleviate the annotation burden and achieve satisfactory detection performance. Specifically, adhering to the consistency training paradigm, we construct a semi-supervised RGB-D RSDI architecture for this task by optimizing structures, perturbation mechanisms, loss settings, etc. Furthermore, we propose a Depth-assisted Multi-scale Cross-modal Fusion Module (DMCFM) that conducts multi-scale exploration and cross-modal complementary fusion with the assistance of depth. Comprehensive experiments demonstrate that, compared to the latest 14 state-of-the-art fully supervised methods, the proposed DSSNet achieves highly competitive results while effectively alleviating an 80% annotation burden.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Depth-Assisted Semi-Supervised RGB-D Rail Surface Defect Inspection


    Contributors:
    Wang, Jie (author) / Li, Guoqiang (author) / Qiu, Guanwen (author) / Ma, Gang (author) / Xi, Jinwen (author) / Yu, Nana (author)


    Publication date :

    2024-07-01


    Size :

    19436529 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Rail inspection device and rail inspection system

    HORII TAKAHIRO / NAKANO YOSHIHIRO | European Patent Office | 2020

    Free access

    RAIL INSPECTION DEVICE AND RAIL INSPECTION SYSTEM

    HORII TAKAHIRO / NAKANO GIYU | European Patent Office | 2018

    Free access

    RAIL INSPECTION DEVICE AND RAIL INSPECTION SYSTEM

    KAWABATA RYUZO / KANDORI AKIHIKO / SHIZAWA NORITAKE et al. | European Patent Office | 2023

    Free access

    Rail inspection equipment and rail inspection vehicle

    ZHAO YONG / XING CUNLIANG / LI PEIYAO et al. | European Patent Office | 2025

    Free access