A General Contextualized Rewriting Framework for Text Summarization
The rewriting method for text summarization combines extractive and abstractive approaches, improving the conciseness and readability of extractive summaries using an abstractive model. Exiting rewriting systems take each extractive sentence as the only input, which is relatively focused but can lose necessary background knowledge and discourse context. In this paper, we investigate contextualized rewriting, which consumes the entire document and considers the summary context. We formalize contextualized rewriting as a seq2seq with group-tag alignments, introducing group-tag as a solution to model the alignments, identifying extractive sentences through content-based addressing. Results show that our approach significantly outperforms non-contextualized rewriting systems without requiring reinforcement learning, achieving strong improvements on ROUGE scores upon multiple extractors.
Code (1)
Tasks
reinforcement-learningReinforcement Learning (RL)SentenceTAGText SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Contextualized Rewriting for Text Summarization
Extractive summarization suffers from irrelevance, redundancy and incoherence. Existing work shows that abstractive rewriting for extractive summaries can improve the conciseness and readability. These rewriting systems …
Extractive Summarizationreinforcement-learningReinforcement Learning (RL)TAG+1Automatic Text Evaluation through the Lens of Wasserstein Barycenters
A new metric \texttt{BaryScore} to evaluate text generation based on deep contextualized embeddings e.g., BERT, Roberta, ELMo) is introduced. This metric is motivated by a new framework relying on optimal transport tools…
Image CaptioningMachine TranslationText GenerationText Summarization+1Controllable Decontextualization of Yes/No Question and Answers into Factual Statements
Yes/No or polar questions represent one of the main linguistic question categories. They consist of a main interrogative clause, for which the answer is binary (assertion or negation). Polar questions and answers (PQA) r…
NegationClustering of Deep Contextualized Representations for Summarization of Biomedical Texts
In recent years, summarizers that incorporate domain knowledge into the process of text summarization have outperformed generic methods, especially for summarization of biomedical texts. However, construction and mainten…
ClusteringLanguage ModelingLanguage ModellingText SummarizationMulti-Document Summarization with Determinantal Point Processes and Contextualized Representations
Emerged as one of the best performing techniques for extractive summarization, determinantal point processes select the most probable set of sentences to form a summary according to a probability measure defined by model…
Document SummarizationExtractive SummarizationMulti-Document SummarizationPoint Processes+1