Deep Supervised Information Bottleneck Hashing For Cross-modal Retrieval Based Computer-aided Diagnosis

Abstract

Mapping X-ray images, radiology reports, and other medical data as binary codes in the common space, which can assist clinicians to retrieve pathology-related data from heterogeneous modalities (i.e., hashing-based cross-modal medical data retrieval), provides a new view to promot computeraided diagnosis. Nevertheless, there remains a barrier to boost medical retrieval accuracy: how to reveal the ambiguous semantics of medical data without the distraction of superfluous information. To circumvent this drawback, we propose Deep Supervised Information Bottleneck Hashing (DSIBH), which effectively strengthens the discriminability of hash codes. Specifically, the Deep Deterministic Information Bottleneck (Yu, Yu, and Principe 2021) for single modality is extended to the cross-modal scenario. Benefiting from this, the superfluous information is reduced, which facilitates the discriminability of hash codes. Experimental results demonstrate the superior accuracy of the proposed DSIBH compared

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyshi2022deep

Related papers

• Discriminative Supervised Hashing For Cross-modal Similarity Search (2018)7.81
• Unsupervised Deep Cross-modality Spectral Hashing (2020)11.39
• Binary Codes For Tagging X-ray Images Via Deep De-noising Autoencoders (2016)7.81
• Exploring Auxiliary Context: Discrete Semantic Transfer Hashing For Scalable Image Retrieval (2019)15.88
• Multi-modal Mutual Information Maximization: A Novel Approach For Unsupervised Deep Cross-modal Hashing (2021)12.02
• Fusion-supervised Deep Cross-modal Hashing (2019)8.60
• FDDH: Fast Discriminative Discrete Hashing For Large-scale Cross-modal Retrieval (2021)15.50
• Combating Ambiguity For Hash-code Learning In Medical Instance Retrieval (2021)7.81