Simple To Complex Cross-modal Learning To Rank
2017 · Minnan Luo, Xiaojun Chang, Zhihui Li, et al.
Abstract
The heterogeneity-gap between different modalities brings a significant challenge to multimedia information retrieval. Some studies formalize the cross-modal retrieval tasks as a ranking problem and learn a shared multi-modal embedding space to measure the cross-modality similarity. However, previous methods often establish the shared embedding space based on linear mapping functions which might not be sophisticated enough to reveal more complicated inter-modal correspondences. Additionally, current studies assume that the rankings are of equal importance, and thus all rankings are used simultaneously, or a small number of rankings are selected randomly to train the embedding space at each iteration. Such strategies, however, always suffer from outliers as well as reduced generalization capability due to their lack of insightful understanding of procedure of human cognition. In this paper, we involve the self-paced learning theory with diversity into the cross-modal learning to rank an
Authors
(none)
Tags
Stats
Related papers
- Continual Learning In Cross-modal Retrieval (2021)9.41
- Integrating Information Theory And Adversarial Learning For Cross-modal Retrieval (2021)10.97
- Maximal Matching Matters: Preventing Representation Collapse For Robust Cross-modal Retrieval (2025)2.26
- Adversarial Cross-modal Retrieval Via Learning And Transferring Single-modal Similarities (2019)8.60
- Generalized Contrastive Learning For Multi-modal Retrieval And Ranking (2024)6.01
- Contrastive Learning For Cross-modal Artist Retrieval (2023)0.00
- Transitive Hashing Network For Heterogeneous Multimedia Retrieval (2016)8.35
- Modality Curation: Building Universal Embeddings For Advanced Multimodal Information Retrieval (2025)0.00