DART: Disease-aware Image-text Alignment And Self-correcting Re-alignment For Trustworthy Radiology Report Generation
2025 · Sang-Jun Park, Keun-Soo Heo, Dong-Hee Shin, et al.
Abstract
The automatic generation of radiology reports has emerged as a promising solution to reduce a time-consuming task and accurately capture critical disease-relevant findings in X-ray images. Previous approaches for radiology report generation have shown impressive performance. However, there remains significant potential to improve accuracy by ensuring that retrieved reports contain disease-relevant findings similar to those in the X-ray images and by refining generated reports. In this study, we propose a Disease-aware image-text Alignment and self-correcting Re-alignment for Trustworthy radiology report generation (DART) framework. In the first stage, we generate initial reports based on image-to-text retrieval with disease-matching, embedding both images and texts in a shared embedding space through contrastive learning. This approach ensures the retrieval of reports with similar disease-relevant findings that closely align with the input X-ray images. In the second stage, we further
Authors
(none)
Tags
Stats
Related papers
- Multimodal Image-text Matching Improves Retrieval-based Chest X-ray Report Generation (2023)3.33
- Beyond The Embedding Bottleneck: Adaptive Retrieval-augmented 3D CT Report Generation (2026)0.00
- Radir: A Scalable Framework For Multi-grained Medical Image Retrieval Via Radiology Report Mining (2025)0.00
- Grounded Multimodal Retrieval-augmented Drafting Of Radiology Impressions Using Case-based Similarity Search (2026)0.00
- Learning Visual-semantic Embeddings For Reporting Abnormal Findings On Chest X-rays (2020)9.76
- Prototype-enhanced Confidence Modeling For Cross-modal Medical Image-report Retrieval (2025)0.00
- Ontology-based Concept Distillation For Radiology Report Retrieval And Labeling (2025)1.20
- Learning To Read Where To Look: Disease-aware Vision-language Pretraining For 3D CT (2026)0.00