Cross-modal hashing is an effective cross-modal retrieval approach because of its low storage and high efficiency. However, most existing methods mainly utilize pre-trained networks to extract modality-specific features, while ignore the position information and lack information interaction between different modalities. To address those problems, in this paper, we propose a novel approach, named cross-modal generation and pair correlation alignment hashing (CMGCAH), which introduces transformer to exploit position information and utilizes cross-modal generative adversarial networks (GAN) to boost cross-modal information interaction. Concretely, a cross-modal interaction network based on conditional generative adversarial network and pair correlation alignment networks are proposed to generate cross-modal common representations. On the other hand, a transformer-based feature extraction network (TFEN) is designed to exploit position information, which can be propagated to text modality and enforce the common representation to be semantically consistent. Experiments are performed on widely used datasets with text-image modalities, and results show that the proposed method achieved competitive performance compared with many existing methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Cross-Modal Generation and Pair Correlation Alignment Hashing


    Beteiligte:
    Ou, Weihua (Autor:in) / Deng, Jiaxin (Autor:in) / Zhang, Lei (Autor:in) / Gou, Jianping (Autor:in) / Zhou, Quan (Autor:in)


    Erscheinungsdatum :

    2023-03-01


    Format / Umfang :

    3206677 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Label Guided Discrete Hashing for Cross-Modal Retrieval

    Lan, Rushi / Tan, Yu / Wang, Xiaoqin et al. | IEEE | 2022



    Weighted Contrastive Hashing

    Yu, Jiaguo / Qiu, Huming / Chen, Dubing et al. | British Library Conference Proceedings | 2023


    Isometric Mapping Hashing

    Liu, Yanzhen / Bai, Xiao / Yang, Haichuan et al. | British Library Conference Proceedings | 2015


    Latent Structure Preserving Hashing

    Liu, L. / Yu, M. / Shao, L. | British Library Online Contents | 2017