Region-based Contrastive Pretraining For Medical Image Retrieval With Anatomic Query

Abstract

We introduce a novel Region-based contrastive pretraining for Medical Image Retrieval (RegionMIR) that demonstrates the feasibility of medical image retrieval with similar anatomical regions. RegionMIR addresses two major challenges for medical image retrieval i) standardization of clinically relevant searching criteria (e.g., anatomical, pathology-based), and ii) localization of anatomical area of interests that are semantically meaningful. In this work, we propose an ROI image retrieval image network that retrieves images with similar anatomy by extracting anatomical features (via bounding boxes) and evaluate similarity between pairwise anatomy-categorized features between the query and the database of images using contrastive learning. ROI queries are encoded using a contrastive-pretrained encoder that was fine-tuned for anatomy classification, which generates an anatomical-specific latent space for region-correlated image retrieval. During retrieval, we compare the anatomically enc

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylee2023region

Related papers

• Medical Image Retrieval Using Pretrained Embeddings (2023)7.81
• Content-based Image Retrieval For Multi-class Volumetric Radiology Images: A Benchmark Study (2024)5.24
• Radir: A Scalable Framework For Multi-grained Medical Image Retrieval Via Radiology Report Mining (2025)0.00
• 3D-MIR: A Benchmark And Empirical Study On 3D Medical Image Retrieval In Radiology (2023)0.00
• Content-based 3D Image Retrieval And A Colbert-inspired Re-ranking For Tumor Flagging And Staging (2025)0.00
• Radiomicsretrieval: A Customizable Framework For Medical Image Retrieval Using Radiomics Features (2025)2.29
• Context Aware Query Image Representation For Particular Object Retrieval (2017)11.49
• Selip: Similarity Enhanced Contrastive Language Image Pretraining For Multi-modal Head MRI (2025)3.58