Background Knowledge Grounding for Readable, Relevant, and Factual Biomedical Lay Summaries
Communication of scientific findings to the public is important for keeping non-experts informed of developments such as life-saving medical treatments. However, generating readable lay summaries from scientific documents is challenging, and currently, these summaries suffer from critical factual errors. One popular intervention for improving factuality is using additional external knowledge to provide factual grounding. However, it is unclear how these grounding sources should be retrieved, selected, or integrated, and how supplementary grounding documents might affect the readability or relevance of the generated summaries. We develop a simple method for selecting grounding sources and integrating them with source documents. We then use the BioLaySum summarization dataset to evaluate the effects of different grounding sources on summary quality. We found that grounding source documents improves the relevance and readability of lay summaries but does not improve factuality of lay summaries. This continues to be true in zero-shot summarization settings where we hypothesized that grounding might be even more important for factual lay summaries.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Probing Factually Grounded Content Transfer with Factual Ablation
Despite recent success, large neural models often generate factually incorrect text. Compounding this is the lack of a standard automatic evaluation for factuality--it cannot be meaningfully improved if it cannot be meas…
GROUNDEDKG-RAG: Grounded Knowledge Graph Index for Long-document Question Answering
Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In t…
Semantic Role LabelingQuestion AnsweringKnowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Models
By design, large language models (LLMs) are static general-purpose models, expensive to retrain or update frequently. As they are increasingly adopted for knowledge-intensive tasks, it becomes evident that these design c…
RetrievalGuiding the generation of counterfactual explanations through temporal background knowledge for Predictive Process Monitoring
Counterfactual explanations suggest what should be different in the input instance to change the outcome of an AI system. When dealing with counterfactual explanations in the field of Predictive Process Monitoring, howev…
counterfactualPredictive Process MonitoringA Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepedia
Large language models (LLMs) have an impressive ability to draw on novel information supplied in their context. Yet the mechanisms underlying this contextual grounding remain unknown, especially in situations where conte…
counterfactualLanguage ModelingLanguage ModellingRetrieval+1