Improving Neural Abstractive Document Summarization with Structural Regularization
Recent neural sequence-to-sequence models have shown significant progress on short text summarization. However, for document summarization, they fail to capture the long-term structure of both documents and multi-sentence summaries, resulting in information loss and repetitions. In this paper, we propose to leverage the structural information of both documents and multi-sentence summaries to improve the document summarization performance. Specifically, we import both structural-compression and structural-coverage regularization into the summarization process in order to capture the information compression and information coverage properties, which are the two most important structural properties of document summarization. Experimental results demonstrate that the structural regularization improves the document summarization performance significantly, which enables our model to generate more informative and concise summaries, and thus significantly outperforms state-of-the-art neural abstractive methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationDocument SummarizationMachine TranslationSentenceSentence SummarizationText GenerationText SummarizationSimilar Papers 제목 키워드 기반
Abstractive Multi-Document Summarization via Joint Learning with Single-Document Summarization
Single-document and multi-document summarizations are very closely related in both task definition and solution method. In this work, we propose to improve neural abstractive multi-document summarization by jointly learn…
DecoderDocument SummarizationMulti-Document SummarizationAdapting Neural Single-Document Summarization Model for Abstractive Multi-Document Summarization: A Pilot Study
Till now, neural abstractive summarization methods have achieved great success for single document summarization (SDS). However, due to the lack of large scale multi-document summaries, such methods can be hardly applied…
Abstractive Text SummarizationDocument SummarizationMachine TranslationMulti-Document Summarization+1Unsupervised Abstractive Summarization of Bengali Text Documents
Abstractive summarization systems generally rely on large collections of document-summary pairs. However, the performance of abstractive systems remains a challenge due to the unavailability of parallel data for low-reso…
Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling+2Abstractive Document Summarization with a Graph-Based Attentional Neural Model
Abstractive summarization is the ultimate goal of document summarization research, but previously it is less investigated due to the immaturity of text generation techniques. Recently impressive progress has been made to…
Abstractive Text SummarizationDocument SummarizationImage CaptioningMachine Translation+4Neural Abstractive Summarization with Structural Attention
Attentional, RNN-based encoder-decoder architectures have achieved impressive performance on abstractive summarization of news articles. However, these methods fail to account for long term dependencies within the senten…
Abstractive Text SummarizationArticlesCommunity Question AnsweringDecoder+4