Radiomicsretrieval: A Customizable Framework For Medical Image Retrieval Using Radiomics Features

Abstract

Medical image retrieval is a valuable field for supporting clinical decision-making, yet current methods primarily support 2D images and require fully annotated queries, limiting clinical flexibility. To address this, we propose RadiomicsRetrieval, a 3D content-based retrieval framework bridging handcrafted radiomics descriptors with deep learning-based embeddings at the tumor level. Unlike existing 2D approaches, RadiomicsRetrieval fully exploits volumetric data to leverage richer spatial context in medical images. We employ a promptable segmentation model (e.g., SAM) to derive tumor-specific image embeddings, which are aligned with radiomics features extracted from the same tumor via contrastive learning. These representations are further enriched by anatomical positional embedding (APE). As a result, RadiomicsRetrieval enables flexible querying based on shape, location, or partial feature sets. Extensive experiments on both lung CT and brain MRI public datasets demonstrate that radi

Stats

• citations0
• S2 citations—
• github stars13
• HF likes0
• heat score2.29
• arxiv keyna2025radiomicsretrieval

Related papers

• Radir: A Scalable Framework For Multi-grained Medical Image Retrieval Via Radiology Report Mining (2025)0.00
• 3D-MIR: A Benchmark And Empirical Study On 3D Medical Image Retrieval In Radiology (2023)0.00
• Content-based 3D Image Retrieval And A Colbert-inspired Re-ranking For Tumor Flagging And Staging (2025)0.00
• Content-based Image Retrieval For Multi-class Volumetric Radiology Images: A Benchmark Study (2024)5.24
• Medical Image Retrieval Using Pretrained Embeddings (2023)7.81
• BIMCV-R: A Landmark Dataset For 3D CT Text-image Retrieval (2024)8.09
• Medimageinsight: An Open-source Embedding Model For General Domain Medical Imaging (2024)0.00
• M3ret: Unleashing Zero-shot Multimodal Medical Image Retrieval Via Self-supervision (2025)0.00