SCH-GAN: Semi-supervised Cross-modal Hashing By Generative Adversarial Network

Abstract

Cross-modal hashing aims to map heterogeneous multimedia data into a common Hamming space, which can realize fast and flexible retrieval across different modalities. Supervised cross-modal hashing methods have achieved considerable progress by incorporating semantic side information. However, they mainly have two limitations: (1) Heavily rely on large-scale labeled cross-modal training data which are labor intensive and hard to obtain. (2) Ignore the rich information contained in the large amount of unlabeled data across different modalities, especially the margin examples that are easily to be incorrectly retrieved, which can help to model the correlations. To address these problems, in this paper we propose a novel Semi-supervised Cross-Modal Hashing approach by Generative Adversarial Network (SCH-GAN). We aim to take advantage of GAN's ability for modeling data distributions to promote cross-modal hashing learning in an adversarial way. The main contributions can be summarized as fo

Stats

• citations100
• S2 citations—
• github stars0
• HF likes0
• heat score15.03
• arxiv keyzhang2018sch

Related papers

• Unsupervised Generative Adversarial Cross-modal Hashing (2017)16.47
• Hashgan:attention-aware Deep Adversarial Hashing For Cross Modal Retrieval (2017)15.34
• Deep Semantic Hashing With Generative Adversarial Networks (2018)13.50
• Coupled Cyclegan: Unsupervised Hashing Network For Cross-modal Retrieval (2019)14.76
• Self-supervised Adversarial Hashing Networks For Cross-modal Retrieval (2018)19.56
• Unsupervised Multi-modal Hashing For Cross-modal Retrieval (2019)8.35
• Coophash: Cooperative Learning Of Multipurpose Descriptor And Contrastive Pair Generator Via Variational MCMC Teaching For Supervised Image Hashing (2022)0.00
• Fusion-supervised Deep Cross-modal Hashing (2019)8.60