Fusing infrared and visible images taken by an unmanned aerial vehicle (UAV) is a challenging task, since infrared images distinguish the target from the background by the difference in infrared radiation, while the low resolution also produces a less pronounced effect. Conversely, the visible light spectrum has a high spatial resolution and rich texture; however, it is easily affected by harsh weather conditions like low light. Therefore, the fusion of infrared and visible light has the potential to provide complementary advantages. In this paper, we propose a multi-scale dense feature-aware network via integrated attention for infrared and visible image fusion, namely DFA-Net. Firstly, we construct a dual-channel encoder to extract the deep features of infrared and visible images. Secondly, we adopt a nested decoder to adequately integrate the features of various scales of the encoder so as to realize the multi-scale feature representation of visible image detail texture and infrared image salient target. Then, we present a feature-aware network via integrated attention to further fuse the feature information of different scales, which can focus on specific advantage features of infrared and visible images. Finally, we use unsupervised gradient estimation and intensity loss to learn significant fusion features of infrared and visible images. In addition, our proposed DFA-Net approach addresses the challenges of fusing infrared and visible images captured by a UAV. The results show that DFA-Net achieved excellent image fusion performance in nine quantitative evaluation indexes under a low-light environment.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    DFA-Net: Multi-Scale Dense Feature-Aware Network via Integrated Attention for Unmanned Aerial Vehicle Infrared and Visible Image Fusion


    Beteiligte:
    Sen Shen (Autor:in) / Di Li (Autor:in) / Liye Mei (Autor:in) / Chuan Xu (Autor:in) / Zhaoyi Ye (Autor:in) / Qi Zhang (Autor:in) / Bo Hong (Autor:in) / Wei Yang (Autor:in) / Ying Wang (Autor:in)


    Erscheinungsdatum :

    2023




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Unmanned aerial vehicle infrared visible light camera mount and unmanned aerial vehicle

    LI YONG / YANG JI / PAN YIFENG et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Integrated unmanned aerial vehicle wing rotating mechanism and integrated unmanned aerial vehicle

    WANG YANWEI / YANG LIGONG / WEN XI et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    SiamMAN: Siamese Multi-Phase Aware Network for Real-Time Unmanned Aerial Vehicle Tracking

    Faxue Liu / Xuan Wang / Qiqi Chen et al. | DOAJ | 2023

    Freier Zugriff

    Infrared-visible image fusion based on regional attention auto-encoder

    Wang, Peng / Huang, Sheng / Liu, Huimin et al. | SPIE | 2023


    Unmanned aerial vehicle panoramic image system, unmanned aerial vehicle and unmanned aerial vehicle panoramic image generation method

    WANG LIANG / WANG SHILIAN / HAN JUNJUN et al. | Europäisches Patentamt | 2024

    Freier Zugriff