paper-with-me

홈 › Papers

Adaptive Parameterization for Neural Dialogue Generation

2020-01-18 · IJCNLP 2019 11 · Hengyi Cai, Hongshen Chen, Cheng Zhang, Yonghao Song, Xiaofang Zhao, Dawei Yin

Neural conversation systems generate responses based on the sequence-to-sequence (SEQ2SEQ) paradigm. Typically, the model is equipped with a single set of learned parameters to generate responses for given input contexts. When confronting diverse conversations, its adaptability is rather limited and the model is hence prone to generate generic responses. In this work, we propose an {\bf Ada}ptive {\bf N}eural {\bf D}ialogue generation model, \textsc{AdaND}, which manages various conversations with conversation-specific parameterization. For each conversation, the model generates parameters of the encoder-decoder by referring to the input context. In particular, we propose two adaptive parameterization mechanisms: a context-aware and a topic-aware parameterization mechanism. The context-aware parameterization directly generates the parameters by capturing local semantics of the given context. The topic-aware parameterization enables parameter sharing among conversations with similar topics by first inferring the latent topics of the given context and then generating the parameters with respect to the distributional topics. Extensive experiments conducted on a large-scale real-world conversational dataset show that our model achieves superior performance in terms of both quantitative metrics and human evaluations.

📄 PDF Abstract BibTeX arXiv:2001.06626

Code (1)

hengyicai/AdaND 공식 구현 pytorch

Tasks

DecoderDialogue Generation

Similar Papers 제목 키워드 기반

Meta-Learning the Difference: Preparing Large Language Models for Efficient Adaptation

2022-07-07 · Zejiang Hou, Julian Salazar, George Polovets

Large pretrained language models (PLMs) are often domain- or task-adapted via fine-tuning or prompting. Finetuning requires modifying all of the parameters and having enough data to avoid overfitting while prompting requ…

Abstractive Text SummarizationLanguage ModelingLanguage ModellingMeta-Learning

Twin Co-Adaptive Dialogue for Progressive Image Generation

2025-04-21 · Jianhui Wang, Yangfan He, Yan Zhong, Xinyuan Song 외

Modern text-to-image generation systems have enabled the creation of remarkably realistic and high-quality visuals, yet they often falter when handling the inherent ambiguities in user prompts. In this work, we present T…

Image GenerationText to Image GenerationText-to-Image Generation

Adaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement Learning

2022-09-16 · COLING 2022 10 · Atsumoto Ohashi, Ryuichiro Higashinaka

When a natural language generation (NLG) component is implemented in a real-world task-oriented dialogue system, it is necessary to generate not only natural utterances as learned on training data but also utterances ada…

Natural Language Understandingreinforcement-learningReinforcement LearningReinforcement Learning (RL)+3

Learning from Easy to Complex: Adaptive Multi-curricula Learning for Neural Dialogue Generation

2020-03-02 · Hengyi Cai, Hongshen Chen, Cheng Zhang, Yonghao Song 외

Current state-of-the-art neural dialogue systems are mainly data-driven and are trained on human-generated responses. However, due to the subjectivity and open-ended nature of human conversations, the complexity of train…

Dialogue GenerationReinforcement LearningSpecificity

Adaptive Bridge between Training and Inference for Dialogue Generation

2021-11-01 · EMNLP 2021 11 · Haoran Xu, Hainan Zhang, Yanyan Zou, Hongshen Chen 외

Although exposure bias has been widely studied in some NLP tasks, it faces its unique challenges in dialogue response generation, the representative one-to-various generation scenario.In real human dialogue, there are ma…

Dialogue GenerationNMTResponse Generation