With the development of remote sensing, semantic segmentation of high-resolution remote sensing images (RSIs) is increasingly essential. At the same time, the characteristics of objects in RSIs, such as large size, variation in object scales, and complex details, make it necessary to capture both long-range context and local information. There are some methods such as Fully Convolutional Networks (FCN) and Pyramid Scene Parsing Network (PSPNet) lack the ability to capture long-range dependencies, due to the limited receptive field of Convolutional Neural Network (CNN). However, the self-attention mechanism to capture the correlation between pixels in Transformer models has remarkable capability in capturing long-range context. One of the most outstanding Transformer models is the Masked-attention Mask Transformer (Mask2Former) which adopts the mask classification method. We propose a model SeMask-Mask2Former with boundary loss. Semantically Masked (Se-Mask) is the model's backbone and Mask2Former is the decoder. Concretely, the mask classification that generates one or even more masks for specific categories to perform the elaborate segmentation is especially suitable for handling the characteristic of large within-class and small inter-class variance of RSIs. Above all, extensive experimental results show that SeMask-Mask2Former obtains better results in semantic segmentation of high-resolution RSIs on the ISPRS Potsdam dataset compared to CNN-based methods and other state-of-the-art transformer-based methods. Extensive ablation studies conducted on the Potsdam dataset verifies the contribution of each component or optimization strategy in SeMask-Mask2Former.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    SeMask-Mask2Former: A Semantic Segmentation Model for High Resolution Remote Sensing Images


    Beteiligte:
    Oiao, Yicheng (Autor:in) / Liu, Wei (Autor:in) / Liang, Bin (Autor:in) / Wang, Pengyun (Autor:in) / Zhang, Haopeng (Autor:in) / Vang, Junli (Autor:in)


    Erscheinungsdatum :

    2023-03-04


    Format / Umfang :

    1211575 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Railroad semantic segmentation on high-resolution images

    Belyaev, Sergey / Popov, Igor / Shubnikov, Vladislav et al. | IEEE | 2020



    Efficient Semantic Segmentation with Hyperspectral Images

    Peña, Fernando / Vidal Aguilar, Pilar / Suarez Gracia, Darío et al. | Springer Verlag | 2022


    Spots segmentation in SAR images for remote sensing of environment

    Araujo, R.T.S. / Medeiros, F.N.S. / Costa, R.C.S. et al. | IEEE | 2004


    SEMANTIC SEGMENTATION OF ROADS IN HIGH-RESOLUTION SATELLITE IMAGERY

    Al-Saad, Mina / Aburaed, Nour / Mansoori, Saeed Al et al. | TIBKAT | 2021