paper-with-me

홈 › Papers

AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentation

2021-06-10 · ACL 2021 5 · Xinnuo Xu, Guoyin Wang, Young-Bum Kim, Sungjin Lee

Natural Language Generation (NLG) is a key component in a task-oriented dialogue system, which converts the structured meaning representation (MR) to the natural language. For large-scale conversational systems, where it is common to have over hundreds of intents and thousands of slots, neither template-based approaches nor model-based approaches are scalable. Recently, neural NLGs started leveraging transfer learning and showed promising results in few-shot settings. This paper proposes AUGNLG, a novel data augmentation approach that combines a self-trained neural retrieval model with a few-shot learned NLU model, to automatically create MR-to-Text data from open-domain texts. The proposed system mostly outperforms the state-of-the-art methods on the FewShotWOZ data in both BLEU and Slot Error Rate. We further confirm improved results on the FewShotSGD data and provide comprehensive analysis results on key components of our system. Our code and data are available at https://github.com/XinnuoXu/AugNLG.

📄 PDF Abstract BibTeX arXiv:2106.05589

Code (1)

XinnuoXu/AugNLG 공식 구현 pytorch

Tasks

Data AugmentationRetrievalText GenerationTransfer Learning

Similar Papers 제목 키워드 기반

LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training

2021-12-02 · Shumin Deng, Jiacheng Yang, Hongbin Ye, Chuanqi Tan 외

Natural language generation from structured data mainly focuses on surface-level descriptions, suffering from uncontrollable content selection and low fidelity. Previous works leverage logical forms to facilitate logical…

Text Generation

Getting to Production with Few-shot Natural Language Generation Models

2021-07-01 · SIGDIAL (ACL) 2021 7 · Peyman Heidari, Arash Einolghozati, Shashank Jain, Soumya Batra 외

In this paper, we study the utilization of pre-trained language models to enable few-shotNatural Language Generation (NLG) in task-oriented dialog systems. We introduce a system consisting of iterative self-training and …

Language ModelingLanguage ModellingText Generation

Curriculum-Based Self-Training Makes Better Few-Shot Learners for Data-to-Text Generation

2022-06-06 · Pei Ke, Haozhe Ji, Zhenyu Yang, Yi Huang 외

Despite the success of text-to-text pre-trained models in various natural language generation (NLG) tasks, the generation performance is largely restricted by the number of labeled data in downstream tasks, particularly …

Data-to-Text GenerationText GenerationUnsupervised Pre-training

Universal Self-Adaptive Prompting

2023-05-24 · Xingchen Wan, Ruoxi Sun, Hootan Nakhost, Hanjun Dai 외

A hallmark of modern large language models (LLMs) is their impressive general zero-shot and few-shot abilities, often elicited through in-context learning (ICL) via prompting. However, while highly coveted and being the …

In-Context LearningNatural Language UnderstandingText GenerationZero-Shot Learning

Perceptual Self-Reflection in Agentic Physics Simulation Code Generation

2026-02-12 · Prashant Shende, Bradley Camburn arxiv

We present a multi-agent framework for generating physics simulation code from natural language descriptions, featuring a novel perceptual self-reflection mechanism for validation. The system employs four specialized age…

Code Generation