paper-with-me

Papers

Improving Radiology Report Generation Systems by Removing Hallucinated References to Non-existent Priors

2022-09-27 · Vignav Ramesh, Nathan Andrew Chi, Pranav Rajpurkar

Current deep learning models trained to generate radiology reports from chest radiographs are capable of producing clinically accurate, clear, and actionable text that can advance patient care. However, such systems all succumb to the same problem: making hallucinated references to non-existent prior reports. Such hallucinations occur because these models are trained on datasets of real-world patient reports that inherently refer to priors. To this end, we propose two methods to remove references to priors in radiology reports: (1) a GPT-3-based few-shot approach to rewrite medical reports without references to priors; and (2) a BioBERT-based token classification approach to directly remove words referring to priors. We use the aforementioned approaches to modify MIMIC-CXR, a publicly available dataset of chest X-rays and their associated free-text radiology reports; we then retrain CXR-RePaiR, a radiology report generation system, on the adapted MIMIC-CXR dataset. We find that our re-trained model--which we call CXR-ReDonE--outperforms previous report generation methods on clinical metrics, achieving an average BERTScore of 0.2351 (2.57% absolute improvement). We expect our approach to be broadly valuable in enabling current radiology report generation systems to be more directly integrated into clinical pipelines.

📄 PDF Abstract BibTeX arXiv:2210.06340

Code (1)

rajpurkarlab/cxr-redone 공식 구현 pytorch

Tasks

token-classificationToken Classification

Similar Papers 제목 키워드 기반

Retrieval Augmented Chest X-Ray Report Generation using OpenAI GPT models

2023-05-05 · Mercy Ranjit, Gopinath Ganapathy, Ranjit Manuel, Tanuja Ganu

We propose Retrieval Augmented Generation (RAG) as an approach for automated radiology report writing that leverages multimodally aligned embeddings from a contrastively pretrained vision language model for retrieval of …

Instruction FollowingLanguage ModelingLanguage ModellingRAG+2

Calibrated Confidence Expression for Radiology Report Generation

2026-03-31 · David Bani-Harouni, Chantal Pellegrini, Julian Lüers, Su Hwan Kim 외 arxiv

Safe deployment of Large Vision-Language Models (LVLMs) in radiology report generation requires not only accurate predictions but also clinically interpretable indicators of when outputs should be thoroughly reviewed, en…

Reinforcement Learning

Direct Preference Optimization for Suppressing Hallucinated Prior Exams in Radiology Report Generation

2024-06-10 · Oishi Banerjee, Hong-Yu Zhou, Subathra Adithan, Stephen Kwak 외

Recent advances in generative vision-language models (VLMs) have exciting potential implications for AI in radiology, yet VLMs are also known to produce hallucinations, nonsensical text, and other unwanted behaviors that…

Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation

2020-10-20 · NAACL 2021 4 · Yasuhide Miura, Yuhao Zhang, Emily Bao Tsai, Curtis P. Langlotz 외

Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. However, existing…

Image to textNatural Language InferenceText Generation

RadOT-Eval: Auditable Structured-Evidence Transport for Radiology Report Evaluation

2026-06-07 · Weixin Liu, Juming Xiong, Yang Li, Qingyuan Song 외 arxiv

Automatic evaluation is critical for high-stakes text generation, where errors often involve omitted findings, hallucinated content, polarity reversals, location changes, uncertainty mismatches, and temporal-comparison e…

Text Generation