paper-with-me

홈 › Papers

Lexicon-constrained Copying Network for Chinese Abstractive Summarization

2020-10-16 · Boyan Wan, Mishal Sohail

Copy mechanism allows sequence-to-sequence models to choose words from the input and put them directly into the output, which is finding increasing use in abstractive summarization. However, since there is no explicit delimiter in Chinese sentences, most existing models for Chinese abstractive summarization can only perform character copy, resulting in inefficient. To solve this problem, we propose a lexicon-constrained copying network that models multi-granularity in both encoder and decoder. On the source side, words and characters are aggregated into the same input memory using a Transformerbased encoder. On the target side, the decoder can copy either a character or a multi-character word at each time step, and the decoding process is guided by a word-enhanced search algorithm that facilitates the parallel computation and encourages the model to copy more words. Moreover, we adopt a word selector to integrate keyword information. Experiments results on a Chinese social media dataset show that our model can work standalone or with the word selector. Both forms can outperform previous character-based models and achieve competitive performances.

📄 PDF Abstract BibTeX arXiv:2010.08197

Code (0)

등록된 구현이 없습니다.

Tasks

Abstractive Text SummarizationDecoder

Similar Papers 제목 키워드 기반

Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization

2021-11-01 · EMNLP 2021 11 · Haoran Li, Song Xu, Peng Yuan, Yujia Wang 외

The copying mechanism has had considerable success in abstractive summarization, facilitating models to directly copy words from the input text to the output summary. Existing works mostly employ encoder-decoder attentio…

Abstractive Text SummarizationDecoderNews Summarization

Controlling the Amount of Verbatim Copying in Abstractive Summarization

2019-11-23 · Kaiqiang Song, Bingqing Wang, Zhe Feng, Liu Ren 외

An abstract must not change the meaning of the original text. A single most effective way to achieve that is to increase the amount of copying while still allowing for text abstraction. Human editors can usually exercise…

Abstractive Text SummarizationLanguage ModelingLanguage ModellingText Summarization

PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization

2023-05-11 · Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao 외

Based on the remarkable achievements of pre-trained language models in abstractive summarization, the copying mechanism has proved helpful by improving the factuality, stability, and overall performance. This work propos…

Abstractive Text Summarization

Sequential Copying Networks

2018-07-06 · Qingyu Zhou, Nan Yang, Furu Wei, Ming Zhou

Copying mechanism shows effectiveness in sequence-to-sequence based neural network models for text generation tasks, such as abstractive sentence summarization and question generation. However, existing works on modeling…

DecoderQuestion GenerationQuestion-GenerationSentence+2

Controlling Decoding for More Abstractive Summaries with Copy-Based Networks

2018-03-19 · Noah Weber, Leena Shekhar, Niranjan Balasubramanian, Kyunghyun Cho

Attention-based neural abstractive summarization systems equipped with copy mechanisms have shown promising results. Despite this success, it has been noticed that such a system generates a summary by mostly, if not enti…

Abstractive Text SummarizationExtractive Summarization