Multi-source sensors, such as LiDAR, cameras, Inertial Measurement Units (IMU), and suspension displacement sensors, can describe road surface characteristics from different dimensions. Sensor fusion, which incorporates vehicle dynamic characteristics, is a key to improving the accuracy of road surface identification. Therefore, we propose a road surface identification method that combines segmented image features, statistically analyzed and extracted LiDAR features, and vehicle state features, with suspension displacement serving as a supervisory signal. The visual features from cameras and LiDAR inputs are extracted using the Transfuser backbone. Meanwhile, vehicle state features are encoded separately using Fourier Feature Mapping and a Multilayer Perceptron (MLP), and are subsequently fused with the visual features. The accuracy of road surface identification is further improved through the use of a state feature dropout module and a suspension displacement supervision module during the training process. Experimental results show that our method effectively combines multi-source sensor information and achieves higher accuracy in road surface identification compared to single-sensor-based methods and other multi-sensor fusion approaches. Furthermore, comparative road surface identification tests under constant and variable vehicle speeds, conducted under the same road conditions, demonstrate that our method is not affected by the type of vehicle motion, due to the supervision module based on the decoupled suspension displacement signal.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multimodal Sensor Fusion for Road Surface Identification Considering Vehicle Dynamic Characteristics


    Beteiligte:
    Yang, Yiting (Autor:in) / Xiao, Yao (Autor:in) / Tan, Yingqi (Autor:in) / Li, Ji (Autor:in) / Wang, Boyang (Autor:in) / Liu, Haiou (Autor:in)


    Erscheinungsdatum :

    22.06.2025


    Format / Umfang :

    2713492 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    MULTIMODAL VEHICLE SENSOR FUSION AND STREAMING

    DATTATRAYA VINAYAKA / GORHAM CHRISTOPHER / BOUSHLEY CURTIS et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    Road Surface Identification Approach Based on Vehicle Dynamic Parameters

    Wang, Bo ;Sun, Ren Yun ;Liu, Xi Ming | Trans Tech Publications | 2010


    Road slope dynamic updating method considering vehicle control state

    ZENG WEI / WANG CHAOMEI / XIANG TAO et al. | Europäisches Patentamt | 2022

    Freier Zugriff


    Sensor fusion method for off-road vehicle position estimation

    Guo, Linsong / Zhang, Qin / Han, Shufeng | SPIE | 2002