Abstract Due to the fast progress of Deep Learning (DL) methods in remote sensing applications, many change detection (CD) algorithms have been recently proposed based on CNN networks and the mechanism of self-attention. These algorithms extract features without focusing on the temporal dependency between features. This shortcoming led to the introduction of the Transformer mechanism. In this paper, we design a convolutional transformer network with a Siamese U-shaped structure and name it CTS-Unet to solve the CD problem. We exploit the ability of the CNN to extract effective semantic features and that of the transformer to extract global information effectively. The Siamese architecture allows using CNN to simultaneously extract effective semantic features from low-resolution bi-temporal images. The transformer part contains an encoder and a decoder, all of which use the Swin transformer module as their basic unit. The encoder processes the features extracted from the CNN using patch merging and the Swin transformer module to produce semantic features. The encoder extracts the detailed information from the features using patch expansion, the Swin transformer module, and convolutional upsampling to create a CD map. The experiments were performed on the widely used LEVIR-CD and DSIFN-CD datasets. Compared with other state-of-the-art CD methods, CTS-Unet provides higher performance with F1-scores of 91.87% and 69.60% for LEVIR-CD and DSIFN-CD datasets, respectively.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    CTS-Unet : Urban change detection by convolutional Siamese concatenate network with Swin transformer


    Beteiligte:
    Heidary, Farnoosh (Autor:in) / Yazdi, Mehran (Autor:in) / Setoodeh, Peyman (Autor:in) / Dehghani, Maryam (Autor:in)

    Erschienen in:

    Advances in Space Research ; 72 , 10 ; 4272-4281


    Erscheinungsdatum :

    2023-07-31


    Format / Umfang :

    10 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Improving Road Extraction for Autonomous Driving Using Swin Transformer Unet

    Ge, Chao / Nie, Yiming / Kong, Fanjie et al. | IEEE | 2022



    REAL-TIME SMALL-OBJECT CHANGE DETECTION FROM GROUND VEHICLES USING A SIAMESE CONVOLUTIONAL NEURAL NETWORK

    Klomp, Sander R. / Wouw, Dennis W. J. M. Van De / De, Peter H. N. | TIBKAT | 2021


    DST3D: DLA-Swin Transformer for Single-Stage Monocular 3D Object Detection

    Wu, Zhihong / Jiang, Xin / Xu, Ruidong et al. | IEEE | 2022


    Siamese Adaptive Transformer Network for Real-Time Aerial Tracking

    Xing, Daitao / Tsoukalas, Athanasios / Evangeliou, Nikolaos et al. | IEEE | 2022