Generating Multi-Sentence Abstractive Summaries of Interleaved Texts
In multi-participant postings, as in online chat conversations, several conversations or topic threads may take place concurrently. This leads to difficulties for readers reviewing the postings in not only following discussions but also in quickly identifying their essence. A two-step process, disentanglement of interleaved posts followed by summarization of each thread, addresses the issue, but disentanglement errors are propagated to the summarization step, degrading the overall performance. To address this, we propose an end-to-end trainable encoder-decoder network for summarizing interleaved posts. The interleaved posts are encoded hierarchically, i.e., word-to-word (words in a post) followed by post-to-post (posts in a channel). The decoder also generates summaries hierarchically, thread-to-thread (generate thread representations) followed by word-to-word (i.e., generate summary words). Additionally, we propose a hierarchical attention mechanism for interleaved text. Overall, our end-to-end trainable hierarchical framework enhances performance over a sequence to sequence framework by 8-10% on multiple synthetic interleaved texts datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderDisentanglementSentenceSimilar Papers 제목 키워드 기반
Towards Generating Query to Perform Query Focused Abstractive Summarization using Pre-trained Model
Query Focused Abstractive Summarization (QFAS) represents an abstractive summary from the source document based on a given query. To measure the performance of abstractive summarization tasks, different datasets have bee…
Abstractive Text SummarizationLanguage ModelingLanguage ModellingSentenceGenerating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization
Sentence summarization shortens given texts while maintaining core contents of the texts. Unsupervised approaches have been studied to summarize texts without human-written summaries. However, recent unsupervised models …
Abstractive Text Summarizationreinforcement-learningReinforcement Learning (RL)Sentence+2Generating Extended and Multilingual Summaries with Pre-trained Transformers
Almost all summarisation methods and datasets focus on a single language and short summaries. We introduce a new dataset called WikinewsSum for English, German, French, Spanish, Portuguese, Polish, and Italian summarisat…
ArticlesGUIR @ MuP 2022: Towards Generating Topic-aware Multi-perspective Summaries for Scientific Documents
This paper presents our approach for the MuP 2022 shared task —-Multi-Perspective Scientific Document Summarization, where the objective is to enable summarization models to explore methods for generating multi-perspecti…
Document SummarizationScientific Document SummarizationVAE-PGN based Abstractive Model in Multi-stage Architecture for Text Summarization
This paper describes our submission to the TL;DR challenge. Neural abstractive summarization models have been successful in generating fluent and consistent summaries with advancements like the copy (Pointer-generator) a…
Abstractive Text SummarizationExtractive SummarizationSentenceText Summarization