Neighbor-aware Instance Refining With Noisy Labels For Cross-modal Retrieval

Abstract

In recent years, Cross-Modal Retrieval (CMR) has made significant progress in the field of multi-modal analysis. However, since it is time-consuming and labor-intensive to collect large-scale and well-annotated data, the annotation of multi-modal data inevitably contains some noise. This will degrade the retrieval performance of the model. To tackle the problem, numerous robust CMR methods have been developed, including robust learning paradigms, label calibration strategies, and instance selection mechanisms. Unfortunately, they often fail to simultaneously satisfy model performance ceilings, calibration reliability, and data utilization rate. To overcome the limitations, we propose a novel robust cross-modal learning framework, namely Neighbor-aware Instance Refining with Noisy Labels (NIRNL). Specifically, we first propose Cross-modal Margin Preserving (CMP) to adjust the relative distance between positive and negative pairs, thereby enhancing the discrimination between sample pairs

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keyliu2025neighbor

Related papers

• PCSR: Pseudo-label Consistency-guided Sample Refinement For Noisy Correspondence Learning (2025)0.00
• A Unified Optimal Transport Framework For Cross-modal Retrieval With Noisy Labels (2024)5.24
• Robust Self-paced Hashing For Cross-modal Retrieval With Noisy Labels (2025)7.81
• MCA: 2D-3D Retrieval With Noisy Labels Via Multi-level Adaptive Correction And Alignment (2025)0.00
• INTENT: Invariance And Discrimination-aware Noise Mitigation For Robust Composed Image Retrieval (2026)0.00
• Semantic-consistent Bidirectional Contrastive Hashing For Noisy Multi-label Cross-modal Retrieval (2025)0.00
• NCL-CIR: Noise-aware Contrastive Learning For Composed Image Retrieval (2025)2.26
• Neighborretr: Balancing Hub Centrality In Cross-modal Retrieval (2025)4.17