Spatio-Temporal and Clinical Conditioning for Fine-Grained Radiology Report Retrieval
Radiology is vital to modern healthcare, but rising imaging demand and persistent workforce shortages strain reporting capacity and clinical workflows. Automated radiology report generation has the potential to support radiologists and help alleviate this burden; however, existing retrieval-based methods remain rigid, lack explicit anatomical grounding, and do not account for longitudinal disease progression or available clinical context. In this work, we introduce STAR3, a multimodal, spatio-temporal, attentive retrieval framework for radiology report generation that aligns region-level anatomical information with clinical indications and longitudinal changes across chest X-ray studies. Our framework employs an object detector to identify anatomically meaningful regions and retrieves semantically relevant report sentences conditioned on both current clinical context and changes observed between prior and current examinations. This design enables anatomically and temporally grounded report generation that better reflects clinical reporting practice. Experiments on the MIMIC-CXR dataset demonstrate that STAR3 outperforms current retrieval-based approaches on retrieval, NLP and clinical metrics, highlighting the value of conditioning retrieval anatomically, temporally and clinically for advancing automated radiology report generation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Fine-grained Context and Multi-modal Alignment for Freehand 3D Ultrasound Reconstruction
Fine-grained spatio-temporal learning is crucial for freehand 3D ultrasound reconstruction. Previous works mainly resorted to the coarse-grained spatial features and the separated temporal dependency learning and struggl…
ManagementDiffusionVID: Denoising Object Boxes with Spatio-temporal Conditioning for Video Object Detection
Several existing still image object detectors suffer from image deterioration in videos, such as motion blur, camera defocus, and partial occlusion. We present DiffusionVID, a diffusion model-based video object detector,…
DenoisingGPUObjectobject-detection+2FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editing
Text-driven motion generation has achieved substantial progress with the emergence of diffusion models. However, existing methods still struggle to generate complex motion sequences that correspond to fine-grained descri…
Mixture-of-ExpertsMotion GenerationMotion SynthesisDecoupling Spatio-Temporal Adapter for Fine-Grained Badminton Action Localization
Temporal Action Localization (TAL) has been extensively studied in generic video understanding, while fine-grained sports scenarios, such as professional badminton, remain underexplored due to their complex and subtle sp…
Temporal Action LocalizationDynamic Spatio-Temporal Specialization Learning for Fine-Grained Action Recognition
The goal of fine-grained action recognition is to successfully discriminate between action categories with subtle differences. To tackle this, we derive inspiration from the human visual system which contains specialized…
Action RecognitionFine-grained Action Recognition