Disease-oriented Image Embedding With Pseudo-scanner Standardization For Content-based Image Retrieval On 3D Brain MRI

Abstract

To build a robust and practical content-based image retrieval (CBIR) system that is applicable to a clinical brain MRI database, we propose a new framework -- Disease-oriented image embedding with pseudo-scanner standardization (DI-PSS) -- that consists of two core techniques, data harmonization and a dimension reduction algorithm. Our DI-PSS uses skull stripping and CycleGAN-based image transformations that map to a standard brain followed by transformation into a brain image taken with a given reference scanner. Then, our 3D convolutioinal autoencoders (3D-CAE) with deep metric learning acquires a low-dimensional embedding that better reflects the characteristics of the disease. The effectiveness of our proposed framework was tested on the T1-weighted MRIs selected from the Alzheimer's Disease Neuroimaging Initiative and the Parkinson's Progression Markers Initiative. We confirmed that our PSS greatly reduced the variability of low-dimensional embeddings caused by different scanner a

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keyarai2021disease

Related papers

• Efficient Feature Embedding Of 3D Brain MRI Images For Content-based Image Retrieval With Deep Metric Learning (2019)8.35
• Icbir-sli: Interpretable Content-based Image Retrieval With 2D Slice Embeddings (2025)5.24
• Domain-invariant Feature Learning In Brain MR Imaging For Content-based Image Retrieval (2025)3.58
• Loc-vae: Learning Structurally Localized Representation From 3D Brain MR Images For Content-based Image Retrieval (2022)5.24
• Content-based 3D Image Retrieval And A Colbert-inspired Re-ranking For Tumor Flagging And Staging (2025)0.00
• Content-based Image Retrieval For Multi-class Volumetric Radiology Images: A Benchmark Study (2024)5.24
• Montage Based 3D Medical Image Retrieval From Traumatic Brain Injury Cohort Using Deep Convolutional Neural Network (2018)4.52
• Deepbrainprint: A Novel Contrastive Framework For Brain MRI Re-identification (2023)0.00