Abstract

The development of accurate and scalable cross-modal image-text retrieval methods, where queries from one modality (e.g., text) can be matched to archive entries from another (e.g., remote sensing image) has attracted great attention in remote sensing (RS). Most of the existing methods assume that a reliable multi-modal training set with accurately matched text-image pairs is existing. However, this assumption may not always hold since the multi-modal training sets may include noisy pairs (i.e., textual descriptions/captions associated to training images can be noisy), distorting the learning process of the retrieval methods. To address this problem, we propose a novel unsupervised cross-modal hashing method robust to the noisy image-text correspondences (CHNR). CHNR consists of three modules: 1) feature extraction module, which extracts feature representations of image-text pairs; 2) noise detection module, which detects potential noisy correspondences; and 3) hashing module that gene

Authors

(none)

Tags

  • Cross-Modal Hashing
  • Unsupervised Hashing
  • Supervised Hashing
  • Deep Hashing
  • Image Retrieval

Stats

  • citations8
  • S2 citations
  • github stars0
  • HF likes0
  • heat score7.16
  • arxiv keymikriukov2022an

Related papers