This paper proposes a multi-source data fusion algorithm for rail surface defect detection in both camera-based rail inspection images and ultrasound B-scan images. First, we design a rail surface segmentation algorithm based on image bilateral filtering, Sobel edge detection, and rail surface edge detection to extract the rail surface area. Second, we build a camera and ultrasound data fusion (CUFuse) model for rail surface defect detection, including two main networks: multi-source data feature extraction and multi-scale feature fusion networks. The multi-source data feature extraction network consists of two BoTNet 50 networks as feature extraction networks to extract five stages of features in camera-based images and ultrasound B-scan images. The multi-scale feature fusion network consists of five feature fusion modules to fuse the feature information output by the multi-source data feature extraction network. Finally, we use the CUFuse model to detect the rail surface defect dataset, and output five rail surface state types, including Light, Moderate, Severe, Normal, and Joint. The results show that the accuracy of the CUFuse model is 96.97%, which can accomplish the task of rail surface defect detection on railway sites.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    CUFuse: Camera and Ultrasound Data Fusion for Rail Defect Detection


    Contributors:
    Chen, Zhengxing (author) / Wang, Qihang (author) / He, Qing (author) / Yu, Tianle (author) / Zhang, Min (author) / Wang, Ping (author)

    Published in:

    Publication date :

    2022-11-01


    Size :

    4728157 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Steel rail defect detection method based on phased array ultrasound

    WENG CHENXIN / KIM HO-YOUN / WU ERYONG et al. | European Patent Office | 2023

    Free access

    Signature Analysis on Wheel-Rail Interactions for Rail Defect Detection

    Ho, T.K. / Liu, S.Y. / Tam, H.Y. et al. | British Library Conference Proceedings | 2008


    Data Fusion-Based Obstacle Detection for Rail Transit Scenarios

    Feng, Junyi / Liang, Xiao / Wu, Yingying | British Library Conference Proceedings | 2022


    Vehicle-mounted steel rail defect detection method

    ZHANG HUI / XU CHEN / FAN GUOPENG et al. | European Patent Office | 2022

    Free access

    Data Fusion-Based Obstacle Detection for Rail Transit Scenarios

    Feng, Junyi / Liang, Xiao / Wu, Yingying | SAE Technical Papers | 2022