Accurate detection of 3D objects is vital to the perception of the railway environments for the safe operation autonomous trains, particularly given the complexity of railway environments and the challenges in detecting objects of variable sizes and of distant objects. This study introduces RailFusion, a LiDAR-Camera fusion network for integrating multi-modal features. RailFusion consists of two main modules: Cross-Domain Feature Extraction (CDFE) and Multi-Modal Fusion (MMF). Specifically, the CDFE module is designed with a novel feature extraction method to enhance cross-domain features interaction by utilizing LiDAR spatial depth and image semantic information. The MMF module uses deformable attention for aligning and fusing multi-modal features. Further to this, the channel normalization fusion is proposed to assign channel weights. Experimental results show that the mean average-precision (mAP) of our proposed RailFusion is 57.2%, which is 8.4% higher than the baseline 3D object detection network BEVFusion. Moreover, the results show that RailFusion is applicable to long-range detection as well as for detecting varying sized and short-range objects. All these indicate that RailFusion has the potential to be readily applicable in 3D object detection in railway environments.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    RailFusion: A Lidar-Camera Data Interaction Network for 3-D Railway Object Detection


    Beteiligte:
    Liu, Wentao (Autor:in) / Wang, Yunpeng (Autor:in) / Yu, Guizhen (Autor:in) / Wang, Zhangyu (Autor:in) / Chen, Peng (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.08.2025


    Format / Umfang :

    3404829 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    /LiDAR AUTOMATED OBJECT ANNOTATION USING FUSED CAMERA/LiDAR DATA POINTS

    LIU ZHONGTAO / ESPER JAMES / LEE JONG HO | Europäisches Patentamt | 2025

    Freier Zugriff

    /LiDAR AUTOMATED OBJECT ANNOTATION USING FUSED CAMERA/LiDAR DATA POINTS

    LIU ZHONGTAO / ESPER JAMES / LEE JONG HO | Europäisches Patentamt | 2023

    Freier Zugriff

    IPCC algorithm: Moving object detection in 3D-Lidar and camera data

    Deymier, Clement / Chateau, Thierry | IEEE | 2013


    Automated object annotation using fused camera/LiDAR data points

    LIU ZHONGTAO / ESPER JAMES / LEE JONG HO | Europäisches Patentamt | 2024

    Freier Zugriff