Self-supervised Adversarial Hashing Networks For Cross-modal Retrieval

Abstract

Thanks to the success of deep learning, cross-modal retrieval has made significant progress recently. However, there still remains a crucial bottleneck: how to bridge the modality gap to further enhance the retrieval accuracy. In this paper, we propose a self-supervised adversarial hashing (\textbf\{SSAH\}) approach, which lies among the early attempts to incorporate adversarial learning into cross-modal hashing in a self-supervised fashion. The primary contribution of this work is that two adversarial networks are leveraged to maximize the semantic correlation and consistency of the representations between different modalities. In addition, we harness a self-supervised semantic network to discover high-level semantic information in the form of multi-label annotations. Such information guides the feature learning process and preserves the modality relationships in both the common semantic space and the Hamming space. Extensive experiments carried out on three benchmark datasets validat

Stats

• citations405
• S2 citations—
• github stars0
• HF likes0
• heat score19.56
• arxiv keyli2018self

Related papers

• Hashgan:attention-aware Deep Adversarial Hashing For Cross Modal Retrieval (2017)15.34
• Unsupervised Multi-modal Hashing For Cross-modal Retrieval (2019)8.35
• Task-adaptive Asymmetric Deep Cross-modal Hashing (2020)9.41
• SCH-GAN: Semi-supervised Cross-modal Hashing By Generative Adversarial Network (2018)15.03
• Fusion-supervised Deep Cross-modal Hashing (2019)8.60
• Unsupervised Generative Adversarial Cross-modal Hashing (2017)16.47
• Adaptive Structural Similarity Preserving For Unsupervised Cross Modal Hashing (2022)10.97
• Deep Cross-modal Hashing Via Margin-dynamic-softmax Loss (2020)0.00