Goal-oriented Dialogue Policy Learning from Failures

2018-08-20 · Keting Lu, Shiqi Zhang, Xiaoping Chen

Reinforcement learning methods have been used for learning dialogue policies. However, learning an effective dialogue policy frequently requires prohibitively many conversations. This is partly because of the sparse rewards in dialogues, and the very few successful dialogues in early learning phase. Hindsight experience replay (HER) enables learning from failures, but the vanilla HER is inapplicable to dialogue learning due to the implicit goals. In this work, we develop two complex HER methods providing different trade-offs between complexity and performance, and, for the first time, enabled HER-based dialogue policy learning. Experiments using a realistic user simulator show that our HER methods perform better than existing experience replay methods (as applied to deep Q-networks) in learning rate.

📄 PDF Abstract BibTeX arXiv:1808.06497

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planning

2023-05-23 · Xiao Yu, Maximillian Chen, Zhou Yu

Planning for goal-oriented dialogue often requires simulating future dialogue interactions and estimating task progress. Many approaches thus consider training neural networks to perform look-ahead search algorithms such…

Language Modeling Language Modelling Large Language Model

Learning Goal-oriented Dialogue Policy with Opposite Agent Awareness

2020-04-21 · Asian Chapter of the Association for Computational Linguistics 2020 · Zheng Zhang, Lizi Liao, Xiaoyan Zhu, Tat-Seng Chua 외

Most existing approaches for goal-oriented dialogue policy learning used reinforcement learning, which focuses on the target agent policy and simply treat the opposite agent policy as part of the environment. While in re…

Decision Making Reinforcement Learning

A General Highly Accurate Online Planning Method Integrating Large Language Models into Nested Rollout Policy Adaptation for Dialogue Tasks

2025-11-17 · Hui Wang, Fafa Zhang, Xiaoyu Zhang, Chaoxu Mu arxiv

In goal-oriented dialogue tasks, the main challenge is to steer the interaction towards a given goal within a limited number of turns. Existing approaches either rely on elaborate prompt engineering, whose effectiveness …

Prompt Engineering

Building Advanced Dialogue Managers for Goal-Oriented Dialogue Systems

2018-06-03 · Vladimir Ilievski

Goal-Oriented (GO) Dialogue Systems, colloquially known as goal oriented chatbots, help users achieve a predefined goal (e.g. book a movie ticket) within a closed domain. A first step is to understand the user's goal by …

Deep Reinforcement Learning Goal-Oriented Dialogue Systems Natural Language Understanding Reinforcement Learning+2

Subgoal Discovery for Hierarchical Dialogue Policy Learning

2018-04-20 · EMNLP 2018 10 · Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang 외

Developing agents to engage in complex goal-oriented dialogues is challenging partly because the main learning signals are very sparse in long conversations. In this paper, we propose a divide-and-conquer approach that d…

Hierarchical Reinforcement Learning Reinforcement Learning