paper-with-me

홈 › Papers

Less is More for Improving Automatic Evaluation of Factual Consistency

2024-04-09 · Tong Wang, Ninad Kulkarni, Yanjun Qi

Assessing the factual consistency of automatically generated texts in relation to source context is crucial for developing reliable natural language generation applications. Recent literature proposes AlignScore which uses a unified alignment model to evaluate factual consistency and substantially outperforms previous methods across many benchmark tasks. In this paper, we take a closer look of datasets used in AlignScore and uncover an unexpected finding: utilizing a smaller number of data points can actually improve performance. We process the original AlignScore training dataset to remove noise, augment with robustness-enhanced samples, and utilize a subset comprising 10\% of the data to train an improved factual consistency evaluation model, we call LIM-RA (Less Is More for Robust AlignScore). LIM-RA demonstrates superior performance, consistently outperforming AlignScore and other strong baselines like ChatGPT across four benchmarks (two utilizing traditional natural language generation datasets and two focused on large language model outputs). Our experiments show that LIM-RA achieves the highest score on 24 of the 33 test datasets, while staying competitive on the rest, establishing the new state-of-the-art benchmarks.

📄 PDF Abstract BibTeX arXiv:2404.06579

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language ModelText Generation

Similar Papers 제목 키워드 기반

Probing Factually Grounded Content Transfer with Factual Ablation

2022-03-18 · Findings (ACL) 2022 5 · Peter West, Chris Quirk, Michel Galley, Yejin Choi

Despite recent success, large neural models often generate factually incorrect text. Compounding this is the lack of a standard automatic evaluation for factuality--it cannot be meaningfully improved if it cannot be meas…

Evaluation of Automatic Text Summarization using Synthetic Facts

2022-04-11 · Jay Ahn, Foaad Khosmood

Despite some recent advances, automatic text summarization remains unreliable, elusive, and of limited practical use in applications. Two main problems with current summarization methods are well known: evaluation and fa…

Text Summarization

An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation

2024-11-28 · Joy Mahapatra, Utpal Garain

Large Language Models (LLMs) have shown exceptional performance across various Data-to-Text Generation (DTG) tasks. However, generating factually consistent text in DTG remains challenging for LLMs. Despite this, in-dept…

Data-to-Text GenerationText Generation

Improving Factual Consistency of Abstractive Summarization via Question Answering

2021-05-10 · ACL 2021 5 · Feng Nan, Cicero Nogueira dos santos, Henghui Zhu, Patrick Ng 외

A commonly observed problem with the state-of-the art abstractive summarization models is that the generated summaries can be factually inconsistent with the input documents. The fact that automatic summarization may pro…

Abstractive Text SummarizationQuestion Answering

LongDocFACTScore: Evaluating the Factuality of Long Document Abstractive Summarisation

2023-09-21 · Jennifer A Bishop, Qianqian Xie, Sophia Ananiadou

Maintaining factual consistency is a critical issue in abstractive text summarisation, however, it cannot be assessed by traditional automatic metrics used for evaluating text summarisation, such as ROUGE scoring. Recent…