Query Focused Abstractive Summarization: Incorporating Query Relevance, Multi-Document Coverage, and Summary Length Constraints into seq2seq Models
Query Focused Summarization (QFS) has been addressed mostly using extractive methods. Such methods, however, produce text which suffers from low coherence. We investigate how abstractive methods can be applied to QFS, to overcome such limitations. Recent developments in neural-attention based sequence-to-sequence models have led to state-of-the-art results on the task of abstractive generic single document summarization. Such models are trained in an end to end method on large amounts of training data. We address three aspects to make abstractive summarization applicable to QFS: (a)since there is no training data, we incorporate query relevance into a pre-trained abstractive model; (b) since existing abstractive models are trained in a single-document setting, we design an iterated method to embed abstractive models within the multi-document requirement of QFS; (c) the abstractive models we adapt are trained to generate text of specific length (about 100 words), while we aim at generating output of a different size (about 250 words); we design a way to adapt the target size of the generated summaries to a given size ratio. We compare our method (Relevance Sensitive Attention for QFS) to extractive baselines and with various ways to combine abstractive models on the DUC QFS datasets and demonstrate solid improvements on ROUGE performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationDocument SummarizationQuery-Based Extractive SummarizationQuery-focused SummarizationSimilar Papers 제목 키워드 기반
Improve Query Focused Abstractive Summarization by Incorporating Answer Relevance
Query focused summarization (QFS) models aim to generate summaries from source documents that can answer the given query. Most previous work on QFS only considers the query relevance criterion when producing the summary.…
Abstractive Text SummarizationQuery-focused SummarizationQuestion AnsweringTowards Generating Query to Perform Query Focused Abstractive Summarization using Pre-trained Model
Query Focused Abstractive Summarization (QFAS) represents an abstractive summary from the source document based on a given query. To measure the performance of abstractive summarization tasks, different datasets have bee…
Abstractive Text SummarizationLanguage ModelingLanguage ModellingSentenceCQSumDP: A ChatGPT-Annotated Resource for Query-Focused Abstractive Summarization Based on Debatepedia
Debatepedia is a publicly available dataset consisting of arguments and counter-arguments on controversial topics that has been widely used for the single-document query-focused abstractive summarization task in recent y…
Abstractive Text SummarizationText GenerationA Zero-Resource Approach to Cross-Lingual Query-Focused Abstractive Summarization
We present a novel approach for cross-lingual query-focused abstractive summarization (QFAS) that leverages the translate-then-summarize paradigm. We approach cross-lingual QFAS as a zero-resource problem and introduce a…
Abstractive Text SummarizationDecoderTranslationDomain Adaptation with Pre-trained Transformers for Query Focused Abstractive Text Summarization
The Query Focused Text Summarization (QFTS) task aims at building systems that generate the summary of the text document(s) based on the given query. A key challenge in addressing this task is the lack of large labeled d…
Abstractive Text SummarizationDomain AdaptationText SummarizationTransfer Learning+1