Information-theoretic Hashing For Zero-shot Cross-modal Retrieval

Abstract

Zero-shot cross-modal retrieval (ZS-CMR) deals with the retrieval problem among heterogenous data from unseen classes. Typically, to guarantee generalization, the pre-defined class embeddings from natural language processing (NLP) models are used to build a common space. In this paper, instead of using an extra NLP model to define a common space beforehand, we consider a totally different way to construct (or learn) a common hamming space from an information-theoretic perspective. We term our model the Information-Theoretic Hashing (ITH), which is composed of two cascading modules: an Adaptive Information Aggregation (AIA) module; and a Semantic Preserving Encoding (SPE) module. Specifically, our AIA module takes the inspiration from the Principle of Relevant Information (PRI) to construct a common space that adaptively aggregates the intrinsic semantics of different modalities of data and filters out redundant or irrelevant information. On the other hand, our SPE module further genera

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyshi2022information

Related papers

• Cross-modal Zero-shot Hashing (2019)8.09
• Attribute-guided Network For Cross-modal Zero-shot Hashing (2018)13.93
• Transductive Zero-shot Hashing For Multilabel Image Retrieval (2019)8.82
• Multi-modal Mutual Information Maximization: A Novel Approach For Unsupervised Deep Cross-modal Hashing (2021)12.02
• Transitive Hashing Network For Heterogeneous Multimedia Retrieval (2016)8.35
• Asymmetric Correlation Quantization Hashing For Cross-modal Retrieval (2020)10.74
• Correlation Hashing Network For Efficient Cross-modal Retrieval (2016)11.67
• RREH: Reconstruction Relations Embedded Hashing For Semi-paired Cross-modal Retrieval (2024)2.26