paper-with-me

홈 › Papers

FactReranker: Fact-guided Reranker for Faithful Radiology Report Summarization

2023-03-15 · Qianqian Xie, Jiayu Zhou, Yifan Peng, Fei Wang

Automatic radiology report summarization is a crucial clinical task, whose key challenge is to maintain factual accuracy between produced summaries and ground truth radiology findings. Existing research adopts reinforcement learning to directly optimize factual consistency metrics such as CheXBert or RadGraph score. However, their decoding method using greedy search or beam search considers no factual consistency when picking the optimal candidate, leading to limited factual consistency improvement. To address it, we propose a novel second-stage summarizing approach FactReranker, the first attempt that learns to choose the best summary from all candidates based on their estimated factual consistency score. We propose to extract medical facts of the input medical report, its gold summary, and candidate summaries based on the RadGraph schema and design the fact-guided reranker to efficiently incorporate the extracted medical facts for selecting the optimal summary. We decompose the fact-guided reranker into the factual knowledge graph generation and the factual scorer, which allows the reranker to model the mapping between the medical facts of the input text and its gold summary, thus can select the optimal summary even the gold summary can't be observed during inference. We also present a fact-based ranking metric (RadMRR) for measuring the ability of the reranker on selecting factual consistent candidates. Experimental results on two benchmark datasets demonstrate the superiority of our method in generating summaries with higher factual consistency scores when compared with existing methods.

📄 PDF Abstract BibTeX arXiv:2303.08335

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Generation

Similar Papers 제목 키워드 기반

Beyond Sequential Reranking: Reranker-Guided Search Improves Reasoning Intensive Retrieval

2025-09-08 · Haike Xu, Tong Chen arxiv

The widely used retrieve-and-rerank pipeline faces two critical limitations: they are constrained by the initial retrieval quality of the top-k documents, and the growing computational demands of LLM-based rerankers rest…

Narrative Interpolation for Generating and Understanding Stories

2020-08-17 · Su Wang, Greg Durrett, Katrin Erk

We propose a method for controlled narrative/story generation where we are able to guide the model to produce coherent narratives with user-specified target endings by interpolation: for example, we are told that Jim wen…

SentenceStory Generation

OraPO: Oracle-educated Reinforcement Learning for Data-efficient and Factual Radiology Report Generation

2025-09-23 · Zhuoxiao Chen, Hongyang Yu, Ying Xu, Yadan Luo 외 arxiv

Radiology report generation (RRG) aims to automatically produce clinically faithful reports from chest X-ray images. Prevailing work typically follows a scale-driven paradigm, by multi-stage training over large paired co…

Reinforcement Learning

FaMeSumm: Investigating and Improving Faithfulness of Medical Summarization

2023-11-03 · Nan Zhang, Yusen Zhang, Wu Guo, Prasenjit Mitra 외

Summaries of medical text shall be faithful by being consistent and factual with source inputs, which is an important but understudied topic for safety and efficiency in healthcare. In this paper, we investigate and impr…

Contrastive Learning

Drowning in Documents: Consequences of Scaling Reranker Inference

2024-11-18 · Mathew Jacob, Erik Lindgren, Matei Zaharia, Michael Carbin 외

Rerankers, typically cross-encoders, are often used to re-score the documents retrieved by cheaper initial IR systems. This is because, though expensive, rerankers are assumed to be more effective. We challenge this assu…

RerankingRetrieval