Perceived Text Quality and Readability in Extractive and Abstractive Summaries
We present results from a study investigating how users perceive text quality and readability in extractive and abstractive summaries. We trained two summarisation models on Swedish news data and used these to produce summaries of articles. With the produced summaries, we conducted an online survey in which the extractive summaries were compared to the abstractive summaries in terms of fluency, adequacy and simplicity. We found statistically significant differences in perceived fluency and adequacy between abstractive and extractive summaries but no statistically significant difference in simplicity. Extractive summaries were preferred in most cases, possibly due to the types of errors the summaries tend to have.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesSimilar Papers 제목 키워드 기반
A General Contextualized Rewriting Framework for Text Summarization
The rewriting method for text summarization combines extractive and abstractive approaches, improving the conciseness and readability of extractive summaries using an abstractive model. Exiting rewriting systems take eac…
reinforcement-learningReinforcement Learning (RL)SentenceTAG+1Towards Adaptive Text Summarization: How Does Compression Rate Affect Summary Readability of L2 Texts?
This paper addresses the problem of readability of automatically generated summaries in the context of second language learning. For this we experimented with a new corpus of level-annotated simplified English texts. The…
Abstractive Text SummarizationText SummarizationThe Extractive-Abstractive Spectrum: Uncovering Verifiability Trade-offs in LLM Generations
Across all fields of academic study, experts cite their sources when sharing information. While large language models (LLMs) excel at synthesizing information, they do not provide reliable citation to sources, making it …
Contextualized Rewriting for Text Summarization
Extractive summarization suffers from irrelevance, redundancy and incoherence. Existing work shows that abstractive rewriting for extractive summaries can improve the conciseness and readability. These rewriting systems …
Extractive Summarizationreinforcement-learningReinforcement Learning (RL)TAG+1Multi-document abstractive summarization using ILP based multi-sentence compression
Abstractive summarization is an ideal form of summarization since it can synthesize information from multiple documents to create concise informative summaries. In this work, we aim at developing an abstractive summarize…
Abstractive Text SummarizationDocument SummarizationInformativenessMulti-Document Summarization+2