Label Prediction Framework For Semi-supervised Cross-modal Retrieval

Abstract

Cross-modal data matching refers to retrieval of data from one modality, when given a query from another modality. In general, supervised algorithms achieve better retrieval performance compared to their unsupervised counterpart, as they can learn better representative features by leveraging the available label information. However, this comes at the cost of requiring huge amount of labeled examples, which may not always be available. In this work, we propose a novel framework in a semi-supervised setting, which can predict the labels of the unlabeled data using complementary information from different modalities. The proposed framework can be used as an add-on with any baseline crossmodal algorithm to give significant performance improvement, even in case of limited labeled data. Finally, we analyze the challenging scenario where the unlabeled examples can even come from classes not in the training data and evaluate the performance of our algorithm under such setting. Extensive evalua

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keymandal2019label

Related papers

• Semi-supervised Cross-modal Retrieval With Label Prediction (2018)11.29
• Semi-supervised Hashing For Semi-paired Cross-view Retrieval (2018)6.77
• Swamp: Swapped Assignment Of Multi-modal Pairs For Cross-modal Retrieval (2021)0.00
• Discriminative Supervised Subspace Learning For Cross-modal Retrieval (2022)0.00
• Semcore: A Semantic-enhanced Generative Cross-modal Retrieval Framework With Mllms (2025)0.00
• Learning To Rematch Mismatched Pairs For Robust Cross-modal Retrieval (2024)13.82
• Feature Representation Learning For Unsupervised Cross-domain Image Retrieval (2022)11.46
• Adversarial Cross-modal Retrieval Via Learning And Transferring Single-modal Similarities (2019)8.60