Brain Tumor Image Retrieval Via Multitask Learning

Abstract

Classification-based image retrieval systems are built by training convolutional neural networks (CNNs) on a relevant classification problem and using the distance in the resulting feature space as a similarity metric. However, in practical applications, it is often desirable to have representations which take into account several aspects of the data (e.g., brain tumor type and its localization). In our work, we extend the classification-based approach with multitask learning: we train a CNN on brain MRI scans with heterogeneous labels and implement a corresponding tumor image retrieval system. We validate our approach on brain tumor data which contains information about tumor types, shapes and localization. We show that our method allows us to build representations that contain more relevant information about tumors than single-task classification-based approaches.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keypisov2018brain

Related papers

• Cross-modality Sub-image Retrieval Using Contrastive Multimodal Image Representations (2022)6.32
• Montage Based 3D Medical Image Retrieval From Traumatic Brain Injury Cohort Using Deep Convolutional Neural Network (2018)4.52
• Medical Image Retrieval Using Deep Convolutional Neural Network (2017)19.35
• A Modulation Module For Multi-task Learning With Applications In Image Retrieval (2018)14.58
• Content-based 3D Image Retrieval And A Colbert-inspired Re-ranking For Tumor Flagging And Staging (2025)0.00
• Radiomicsretrieval: A Customizable Framework For Medical Image Retrieval Using Radiomics Features (2025)2.29
• Multi-task Cross-modal Learning For Chest X-ray Image Retrieval (2026)0.00
• Learning Deep Representation Of Multityped Objects And Tasks (2016)0.00