Improving Factuality Of 3D Brain MRI Report Generation With Paired Image-domain Retrieval And Text-domain Augmentation

Abstract

Acute ischemic stroke (AIS) requires time-critical management, with hours of delayed intervention leading to an irreversible disability of the patient. Since diffusion weighted imaging (DWI) using the magnetic resonance image (MRI) plays a crucial role in the detection of AIS, automated prediction of AIS from DWI has been a research topic of clinical importance. While text radiology reports contain the most relevant clinical information from the image findings, the difficulty of mapping across different modalities has limited the factuality of conventional direct DWI-to-report generation methods. Here, we propose paired image-domain retrieval and text-domain augmentation (PIRTA), a cross-modal retrieval-augmented generation (RAG) framework for providing clinician-interpretative AIS radiology reports with improved factuality. PIRTA mitigates the need for learning cross-modal mapping, which poses difficulty in image-to-text generation, by casting the cross-modal mapping problem as an in-

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylee2024improving

Related papers

• Disease-oriented Image Embedding With Pseudo-scanner Standardization For Content-based Image Retrieval On 3D Brain MRI (2021)7.50
• Montage Based 3D Medical Image Retrieval From Traumatic Brain Injury Cohort Using Deep Convolutional Neural Network (2018)4.52
• Grounded Multimodal Retrieval-augmented Drafting Of Radiology Impressions Using Case-based Similarity Search (2026)0.00
• DART: Disease-aware Image-text Alignment And Self-correcting Re-alignment For Trustworthy Radiology Report Generation (2025)4.52
• Beyond The Embedding Bottleneck: Adaptive Retrieval-augmented 3D CT Report Generation (2026)0.00
• Efficient Feature Embedding Of 3D Brain MRI Images For Content-based Image Retrieval With Deep Metric Learning (2019)8.35
• Deepbrainprint: A Novel Contrastive Framework For Brain MRI Re-identification (2023)0.00
• Daug: Diffusion-based Channel Augmentation For Radiology Image Retrieval And Classification (2024)0.00