Uncrewed aerial vehicles (UAVs) are susceptible to malfunctions caused by environmental and human factors. Anomaly detection is a critical technique for ensuring the safe operation of UAVs. However, traditional methods that rely on unimodal sensor data and neural networks often fail to capture the comprehensive characteristics of faulty UAVs, limiting their effectiveness in complex environments. To address these limitations, this article proposes a UAV anomaly detection model that utilizes heterogeneous sensor data and multimodal neural networks [fusion multimodal deep neural networks (FMDNNs)]. First, the FMDNN uses an interpolation-based method for fusing multisource heterogeneous UAV sensor information. This method aligns the sensor data while simulating the distribution of UAV sensor data, enabling the FMDNN to utilize multisensor information to assess the overall state of the UAVs. Second, the FMDNN trains two neural networks of different modalities to extract nonlinear features and key structural features from the fused data by parallel computing using a multilayer perceptron and a convolutional neural network, respectively. Finally, the feature fusion module combines the nonlinear and key structural features to create a fusion vector. The fusion vector is processed by the fully connected layer and used to determine the UAV's state through a Softmax classifier. Experimental results demonstrate that on the ALFA, TLM, and UAVGPSAttack datasets, the FMDNN model achieves higher accuracy than the single-model classifier, by about 2% to 9%, for both the multiclassification task and the binary classification task. At the same time, the FMDNN model has strong robustness under classification tasks with noisy data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Hybrid Multimodal Neural-Network-Based Anomaly Detection Model for UAVs


    Contributors:
    Yang, Tao (author) / Lu, Yu (author) / Deng, Hongli (author) / Tang, Chan (author)

    Published in:

    Publication date :

    2025-08-01


    Size :

    8179232 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Hybrid Dual-Scale Neural Network Model for Tracking Complex Maneuvering UAVs

    Yang Gao / Zhihong Gan / Min Chen et al. | DOAJ | 2023

    Free access

    Synthesis analysis for multi-UAVs formation anomaly detection

    Jianhong, Wang / Yanxiang, Wang | Emerald Group Publishing | 2021


    REMIX: Real-Time Hyperspectral Anomaly Detection for Small UAVs

    Dastranj, Melika / de Smet, Timothy / Wigdahl-Perry, Courtney et al. | IEEE | 2025


    Neural Network Guidance for UAVs

    Julian, Kyle D. / Kochenderfer, Mykel J. | AIAA | 2017


    Unsupervised Scalable Multimodal Driving Anomaly Detection

    Qiu, Yuning / Misu, Teruhisa / Busso, Carlos | IEEE | 2023

    Free access