Abstractive Unsupervised Multi-Document Summarization using Paraphrastic Sentence Fusion
In this work, we aim at developing an unsupervised abstractive summarization system in the multi-document setting. We design a paraphrastic sentence fusion model which jointly performs sentence fusion and paraphrasing using skip-gram word embedding model at the sentence level. Our model improves the information coverage and at the same time abstractiveness of the generated sentences. We conduct our experiments on the human-generated multi-sentence compression datasets and evaluate our system on several newly proposed Machine Translation (MT) evaluation metrics. Furthermore, we apply our sentence level model to implement an abstractive multi-document summarization system where documents usually contain a related set of sentences. We also propose an optimal solution for the classical summary length limit problem which was not addressed in the past research. For the document level summary, we conduct experiments on the datasets of two different domains (e.g., news article and user reviews) which are well suited for multi-document abstractive summarization. Our experiments demonstrate that the methods bring significant improvements over the state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationDocument SummarizationMachine TranslationMulti-Document SummarizationSentenceSentence CompressionSentence FusionText GenerationTranslationSimilar Papers 제목 키워드 기반
Unsupervised Abstractive Summarization of Bengali Text Documents
Abstractive summarization systems generally rely on large collections of document-summary pairs. However, the performance of abstractive systems remains a challenge due to the unavailability of parallel data for low-reso…
Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling+2An Unsupervised Masking Objective for Abstractive Multi-Document News Summarization
We show that a simple unsupervised masking objective can approach near supervised performance on abstractive multi-document news summarization. Our method trains a state-of-the-art neural summarization model to predict t…
Extractive SummarizationNews SummarizationAbsformer: Transformer-based Model for Unsupervised Multi-Document Abstractive Summarization
Multi-document summarization (MDS) refers to the task of summarizing the text in multiple documents into a concise summary. The generated summary can save the time of reading many documents by providing the important con…
Abstractive Text SummarizationDecoderDocument SummarizationLanguage Modeling+4Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation
Summarization of legal case judgement documents is a challenging problem in Legal NLP. However, not much analyses exist on how different families of summarization models (e.g., extractive vs. abstractive) perform when ap…
Abstractive Text SummarizationDocument SummarizationOpen-Ended Question AnsweringTopic-Centric Unsupervised Multi-Document Summarization of Scientific and News Articles
Recent advances in natural language processing have enabled automation of a wide range of tasks, including machine translation, named entity recognition, and sentiment analysis. Automated summarization of documents, or g…
Abstractive Text SummarizationArticlesDocument SummarizationMachine Translation+8