Fusion-supervised Deep Cross-modal Hashing

Abstract

Deep hashing has recently received attention in cross-modal retrieval for its impressive advantages. However, existing hashing methods for cross-modal retrieval cannot fully capture the heterogeneous multi-modal correlation and exploit the semantic information. In this paper, we propose a novel *Fusion-supervised Deep Cross-modal Hashing* (FDCH) approach. Firstly, FDCH learns unified binary codes through a fusion hash network with paired samples as input, which effectively enhances the modeling of the correlation of heterogeneous multi-modal data. Then, these high-quality unified hash codes further supervise the training of the modality-specific hash networks for encoding out-of-sample queries. Meanwhile, both pair-wise similarity information and classification information are embedded in the hash networks under one stream framework, which simultaneously preserves cross-modal similarity and keeps semantic consistency. Experimental results on two benchmark datasets demonstrate the state

Stats

• citations13
• S2 citations—
• github stars0
• HF likes0
• heat score8.60
• arxiv keywang2019fusion

Related papers

• Unsupervised Deep Cross-modality Spectral Hashing (2020)11.39
• Correlation Hashing Network For Efficient Cross-modal Retrieval (2016)11.67
• Deep Cross-modal Hashing With Hashing Functions And Unified Hash Codes Jointly Learning (2019)14.23
• Weakly-paired Cross-modal Hashing (2019)0.00
• FDDH: Fast Discriminative Discrete Hashing For Large-scale Cross-modal Retrieval (2021)15.50
• Deep Class-guided Hashing For Multi-label Cross-modal Retrieval (2024)6.20
• Ranking-based Deep Cross-modal Hashing (2019)13.34
• Discriminative Supervised Hashing For Cross-modal Similarity Search (2018)7.81