Lightweight Contrastive Distilled Hashing For Online Cross-modal Retrieval

Abstract

Deep online cross-modal hashing has gained much attention from researchers recently, as its promising applications with low storage requirement, fast retrieval efficiency and cross modality adaptive, etc. However, there still exists some technical hurdles that hinder its applications, e.g., 1) how to extract the coexistent semantic relevance of cross-modal data, 2) how to achieve competitive performance when handling the real time data streams, 3) how to transfer the knowledge learned from offline to online training in a lightweight manner. To address these problems, this paper proposes a lightweight contrastive distilled hashing (LCDH) for cross-modal retrieval, by innovatively bridging the offline and online cross-modal hashing by similarity matrix approximation in a knowledge distillation framework. Specifically, in the teacher network, LCDH first extracts the cross-modal features by the contrastive language-image pre-training (CLIP), which are further fed into an attention module f

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keyli2025lightweight

Related papers

• Prompthash: Affinity-prompted Collaborative Cross-modal Learning For Adaptive Hashing Retrieval (2025)7.70
• Discriminative Supervised Hashing For Cross-modal Similarity Search (2018)7.81
• FDDH: Fast Discriminative Discrete Hashing For Large-scale Cross-modal Retrieval (2021)15.50
• Efficient Discrete Supervised Hashing For Large-scale Cross-modal Retrieval (2019)11.08
• Fusion-supervised Deep Cross-modal Hashing (2019)8.60
• Semantic-consistent Bidirectional Contrastive Hashing For Noisy Multi-label Cross-modal Retrieval (2025)0.00
• Deep Class-guided Hashing For Multi-label Cross-modal Retrieval (2024)6.20
• Creating Something From Nothing: Unsupervised Knowledge Distillation For Cross-modal Hashing (2020)15.34