SentBS: Sentence-level Beam Search for Controllable Summarization
A wide range of control perspectives have been explored in controllable text generation. Structure-controlled summarization is recently proposed as a useful and interesting research direction. However, current structure-controlling methods have limited effectiveness in enforcing the desired structure. To address this limitation, we propose a sentence-level beam search generation method (SentBS), where evaluation is conducted throughout the generation process to select suitable sentences for subsequent generations. We experiment with different combinations of decoding methods to be used as subcomponents by SentBS and evaluate results on the structure-controlled dataset MReD. Experiments show that all explored combinations for SentBS can improve the agreement between the generated text and the desired structure, with the best method significantly reducing the structural discrepancies suffered by the existing model, by approximately 68%.
Code (1)
Tasks
SentenceText GenerationSimilar Papers 제목 키워드 기반
Towards Controlled and Diverse Generation of Article Comments
Much research in recent years has focused on automatic article commenting. However, few of previous studies focus on the controllable generation of comments. Besides, they tend to generate dull and commonplace comments, …
ArticlesComment GenerationDecoderDiversity+1Generating Diverse Story Continuations with Controllable Semantics
We propose a simple and effective modeling framework for controlled generation of multiple, diverse outputs. We focus on the setting of generating the next sentence of a story given its context. As controllable dimension…
DiversitySentenceUncertainty Determines the Adequacy of the Mode and the Tractability of Decoding in Sequence-to-Sequence Models
In many natural language processing (NLP) tasks the same input (e.g. source sentence) can have multiple possible outputs (e.g. translations). To analyze how this ambiguity (also known as intrinsic uncertainty) shapes the…
Grammatical Error CorrectionMachine TranslationSentenceA Benchmark Dataset for Multi-Level Complexity-Controllable Machine Translation
This paper presents a new benchmark test dataset for multi-level complexity-controllable machine translation (MLCC-MT), which is MT controlling the complexity of the output at more than two levels. In previous research, …
Machine TranslationNMTSentenceTranslationGenerating Diverse Corrections with Local Beam Search for Grammatical Error Correction
In this study, we propose a beam search method to obtain diverse outputs in a local sequence transduction task where most of the tokens in the source and target sentences overlap, such as in grammatical error correction …
Grammatical Error CorrectionSentence