Meta Dialogue Policy Learning
Dialog policy determines the next-step actions for agents and hence is central to a dialogue system. However, when migrated to novel domains with little data, a policy model can fail to adapt due to insufficient interactions with the new environment. We propose Deep Transferable Q-Network (DTQN) to utilize shareable low-level signals between domains, such as dialogue acts and slots. We decompose the state and action representation space into feature subspaces corresponding to these low-level components to facilitate cross-domain knowledge transfer. Furthermore, we embed DTQN in a meta-learning framework and introduce Meta-DTQN with a dual-replay mechanism to enable effective off-policy training and adaptation. In experiments, our model outperforms baseline models in terms of both success rate and dialogue efficiency on the multi-domain dialogue dataset MultiWOZ 2.0.
Code (0)
등록된 구현이 없습니다.
Tasks
Meta-LearningTransfer LearningSimilar Papers 제목 키워드 기반
Meta-Reinforced Multi-Domain State Generator for Dialogue Systems
A Dialogue State Tracker (DST) is a core component of a modular task-oriented dialogue system. Tremendous progress has been made in recent years. However, the major challenges remain. The state-of-the-art accuracy for DS…
Domain AdaptationMeta-LearningReinforcement Learning (RL)Towards the ISO 24617-2-compliant Typology of Metacognitive Events
The paper presents ongoing efforts in design of a typology of metacognitive events observed in a multimodal dialogue. The typology will serve as a tool to identify relations between participants’ dispositions, dialogue a…
A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learning
Dialogue Policy Learning is a key component in a task-oriented dialogue system (TDS) that decides the next action of the system given the dialogue state at each turn. Reinforcement Learning (RL) is commonly chosen to lea…
Dialogue ManagementManagementReinforcement Learning (RL)SurveyTowards Low-Resource Semi-Supervised Dialogue Generation with Meta-Learning
In this paper, we propose a meta-learning based semi-supervised explicit dialogue state tracker (SEDST) for neural dialogue generation, denoted as MEDST. Our main motivation is to further bridge the chasm between the nee…
Dialogue GenerationMeta-LearningPolicy-driven Knowledge Selection and Response Generation for Document-grounded Dialogue
Document-grounded dialogue (DGD) uses documents as external knowledge for dialogue generation. Correctly understanding the dialogue context is crucial for selecting knowledge from the document and generating proper respo…
Dialogue GenerationDialogue UnderstandingResponse Generation