A Pilot Study of Domain Adaptation Effect for Neural Abstractive Summarization
We study the problem of domain adaptation for neural abstractive summarization. We make initial efforts in investigating what information can be transferred to a new domain. Experimental results on news stories and opinion articles indicate that neural summarization model benefits from pre-training based on extractive summaries. We also find that the combination of in-domain and out-of-domain setup yields better summaries when in-domain data is insufficient. Further analysis shows that, the model is capable to select salient content even trained on out-of-domain data, but requires in-domain data to capture the style for a target domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationArticlesDomain AdaptationSimilar Papers 제목 키워드 기반
AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarization
State-of-the-art abstractive summarization models generally rely on extensive labeled data, which lowers their generalization ability on domains where such data are not available. In this paper, we present a study of dom…
Abstractive Text SummarizationDomain AdaptationMultimodal Abstractive Summarization for How2 Videos
In this paper, we study abstractive summarization for open-domain videos. Unlike the traditional text news summarization, the goal is less to "compress" text information but rather to provide a fluent textual summary of …
Abstractive Text SummarizationNews SummarizationText SummarizationAdapting Neural Single-Document Summarization Model for Abstractive Multi-Document Summarization: A Pilot Study
Till now, neural abstractive summarization methods have achieved great success for single document summarization (SDS). However, due to the lack of large scale multi-document summaries, such methods can be hardly applied…
Abstractive Text SummarizationDocument SummarizationMachine TranslationMulti-Document Summarization+1Domain Adaptation with Pre-trained Transformers for Query Focused Abstractive Text Summarization
The Query Focused Text Summarization (QFTS) task aims at building systems that generate the summary of the text document(s) based on the given query. A key challenge in addressing this task is the lack of large labeled d…
Abstractive Text SummarizationDomain AdaptationText SummarizationTransfer Learning+1Domain Adaptation with Pre-trained Transformers for Query-Focused Abstractive Text Summarization
The Query-Focused Text Summarization (QFTS) task aims at building systems that generate the summary of the text document(s) based on the given query. A key challenge in addressing this task is the lack of large labeled d…
Abstractive Text SummarizationDomain AdaptationText SummarizationTransfer Learning+1