Controllable Meaning Representation to Text Generation: Linearization and Data Augmentation Strategies
We study the degree to which neural sequence-to-sequence models exhibit fine-grained controllability when performing natural language generation from a meaning representation. Using two task-oriented dialogue generation benchmarks, we systematically compare the effect of four input linearization strategies on controllability and faithfulness. Additionally, we evaluate how a phrase-based data augmentation method can improve performance. We find that properly aligning input sequences during training leads to highly controllable generation, both when training from scratch or when fine-tuning a larger pre-trained model. Data augmentation further improves control on difficult, randomly generated utterance plans.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDialogue GenerationText GenerationSimilar Papers 제목 키워드 기반
Promoting Graph Awareness in Linearized Graph-to-Text Generation
Generating text from structured inputs, such as meaning representations or RDF triples, has often involved the use of specialized graph-encoding neural networks. However, recent applications of pretrained transformers to…
DenoisingText GenerationSimulation Results of Center-Manifold-Based Identification of Polynomial Nonlinear Systems with Uncontrollable Linearization
Recently, a system identification method based on center manifold is proposed to identify polynomial nonlinear systems with uncontrollable linearization. This note presents a numerical example to show the effectiveness o…
A Partially Rule-Based Approach to AMR Generation
This paper presents a new approach to generating English text from Abstract Meaning Representation (AMR). In contrast to the neural and statistical MT approaches used in other AMR generation systems, this one is largely …
Abstract Meaning RepresentationLanguage ModelingLanguage ModellingConvAMR: Abstract meaning representation parsing for legal document
Convolutional neural networks (CNN) have recently achieved remarkable performance in a wide range of applications. In this research, we equip convolutional sequence-to-sequence (seq2seq) model with an efficient graph lin…
Abstract Meaning RepresentationData-Driven Feedback Linearization of Nonlinear Systems with Periodic Orbits in the Zero-Dynamics
In this article, we present data-driven feedback linearization for nonlinear systems with periodic orbits in the zero-dynamics. This scenario is challenging for data-driven control design because the higher order terms o…
Form