Zero-shot remote sensing image scene classification (ZS-RSISC) aims to identify remote sensing (RS) image scenes of unseen classes whose samples are unavailable in the training stage. To transfer knowledge from seen RS classes to unseen RS classes, existing methods either rely on laborious manual labeling to learn semantic features or directly use the word embeddings learned based on the general corpus and independently of zero-shot models. They ignore the complex interclass correlation information, which plays a vital role in communicating seen with unseen classes. Besides, current studies in ZS-RSISC impose the same penalty to equally constrain each class for the interclass separation and intraclass compactness, which results in unclear classification boundaries. In this article, we tackle ZS-RSISC via graph-based semantic embedding refinement (GSER) in an end-to-end manner. We propose semantic graph convolutional networks (S-GCNs) to explore the correlation structure among classes in a unified framework. The semantic graph embeddings are further refined by the learning of the semantic-guided class patterns and component patterns. Specifically, we propose adaptive additive separation (AAS) loss to adaptively adjust the appropriate penalty for each class and explicitly promote intraclass compactness and interclass separation. Further, instance-level alignment and class-level alignment are proposed to enhance the discriminative ability of the semantic-guided class patterns. To alleviate model bias toward seen classes, semantic-guided component patterns shared by seen and unseen classes are exploited via feature reconstruction. Extensive experiments of both the zero-shot and generalized zero-shot settings demonstrate the effectiveness of our proposed GSER.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Graph-Based Semantic Embedding Refinement for Zero-Shot Remote Sensing Image Scene Classification


    Beteiligte:
    Shang, Junyuan (Autor:in) / Niu, Chang (Autor:in) / Zhou, Wenlve (Autor:in) / Zhou, Zhiheng (Autor:in) / Yang, Junmei (Autor:in)


    Erscheinungsdatum :

    01.02.2024


    Format / Umfang :

    2878829 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Sequential Semantic Knowledge Graph Embedding

    Shang, Yu-Ming / Huang, Heyan / Yuan, Yan | Springer Verlag | 2022



    Towards Traffic Scene Description: The Semantic Scene Graph

    Zipfl, Maximilian / Zollner, J. Marius | IEEE | 2022


    Zero-Shot Visual Recognition via Bidirectional Latent Embedding

    Wang, Q. / Chen, K. | British Library Online Contents | 2017