Cross-modal hashing is an effective cross-modal retrieval approach because of its low storage and high efficiency. However, most existing methods mainly utilize pre-trained networks to extract modality-specific features, while ignore the position information and lack information interaction between different modalities. To address those problems, in this paper, we propose a novel approach, named cross-modal generation and pair correlation alignment hashing (CMGCAH), which introduces transformer to exploit position information and utilizes cross-modal generative adversarial networks (GAN) to boost cross-modal information interaction. Concretely, a cross-modal interaction network based on conditional generative adversarial network and pair correlation alignment networks are proposed to generate cross-modal common representations. On the other hand, a transformer-based feature extraction network (TFEN) is designed to exploit position information, which can be propagated to text modality and enforce the common representation to be semantically consistent. Experiments are performed on widely used datasets with text-image modalities, and results show that the proposed method achieved competitive performance compared with many existing methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Cross-Modal Generation and Pair Correlation Alignment Hashing


    Contributors:
    Ou, Weihua (author) / Deng, Jiaxin (author) / Zhang, Lei (author) / Gou, Jianping (author) / Zhou, Quan (author)


    Publication date :

    2023-03-01


    Size :

    3206677 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Label Guided Discrete Hashing for Cross-Modal Retrieval

    Lan, Rushi / Tan, Yu / Wang, Xiaoqin et al. | IEEE | 2022



    Weighted Contrastive Hashing

    Yu, Jiaguo / Qiu, Huming / Chen, Dubing et al. | British Library Conference Proceedings | 2023


    Isometric Mapping Hashing

    Liu, Yanzhen / Bai, Xiao / Yang, Haichuan et al. | British Library Conference Proceedings | 2015


    Latent Structure Preserving Hashing

    Liu, L. / Yu, M. / Shao, L. | British Library Online Contents | 2017