Affordable On-line Dialogue Policy Learning
The key to building an evolvable dialogue system in real-world scenarios is to ensure an affordable on-line dialogue policy learning, which requires the on-line learning process to be safe, efficient and economical. But in reality, due to the scarcity of real interaction data, the dialogue system usually grows slowly. Besides, the poor initial dialogue policy easily leads to bad user experience and incurs a failure of attracting users to contribute training data, so that the learning process is unsustainable. To accurately depict this, two quantitative metrics are proposed to assess safety and efficiency issues. For solving the unsustainable learning problem, we proposed a complete companion teaching framework incorporating the guidance from the human teacher. Since the human teaching is expensive, we compared various teaching schemes answering the question how and when to teach, to economically utilize teaching budget, so that make the online learning process affordable.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue ManagementSimilar Papers 제목 키워드 기반
Automatic Curriculum Learning With Over-repetition Penalty for Dialogue Policy Learning
Dialogue policy learning based on reinforcement learning is difficult to be applied to real users to train dialogue agents from scratch because of the high cost. User simulators, which choose random user goals for the di…
Integrating Pretrained Language Model for Dialogue Policy Learning
Reinforcement Learning (RL) has been witnessed its potential for training a dialogue policy agent towards maximizing the accumulated rewards given from users. However, the reward can be very sparse for it is usually only…
Language ModelingLanguage ModellingmodelReinforcement Learning (RL)Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach
Reliable automatic evaluation of dialogue systems under an interactive environment has long been overdue. An ideal environment for evaluating dialog systems, also known as the Turing test, needs to involve human interact…
Model-based Reinforcement LearningOff-policy evaluationreinforcement-learningReinforcement Learning+2Using Reinforcement Learning to Model Incrementality in a Fast-Paced Dialogue Game
We apply Reinforcement Learning (RL) to the problem of incremental dialogue policy learning in the context of a fast-paced dialogue game. We compare the policy learned by RL with a high-performance baseline policy which …
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Spoken Dialogue SystemsAffordable Generative Agents
The emergence of large language models (LLMs) has significantly advanced the simulation of believable interactive agents. However, the substantial cost on maintaining the prolonged agent interactions poses challenge over…