GoChat: Goal-oriented Chatbots with Hierarchical Reinforcement Learning
A chatbot that converses like a human should be goal-oriented (i.e., be purposeful in conversation), which is beyond language generation. However, existing dialogue systems often heavily rely on cumbersome hand-crafted rules or costly labelled datasets to reach the goals. In this paper, we propose Goal-oriented Chatbots (GoChat), a framework for end-to-end training chatbots to maximize the longterm return from offline multi-turn dialogue datasets. Our framework utilizes hierarchical reinforcement learning (HRL), where the high-level policy guides the conversation towards the final goal by determining some sub-goals, and the low-level policy fulfills the sub-goals by generating the corresponding utterance for response. In our experiments on a real-world dialogue dataset for anti-fraud in financial, our approach outperforms previous methods on both the quality of response generation as well as the success rate of accomplishing the goal.
Code (0)
등록된 구현이 없습니다.
Tasks
ChatbotHierarchical Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Response GenerationText GenerationSimilar Papers 제목 키워드 기반
Goal-Oriented Chatbot Dialog Management Bootstrapping with Transfer Learning
Goal-Oriented (GO) Dialogue Systems, colloquially known as goal oriented chatbots, help users achieve a predefined goal (e.g. book a movie ticket) within a closed domain. A first step is to understand the user's goal by …
ChatbotDeep Reinforcement LearningManagementNatural Language Understanding+3Building Advanced Dialogue Managers for Goal-Oriented Dialogue Systems
Goal-Oriented (GO) Dialogue Systems, colloquially known as goal oriented chatbots, help users achieve a predefined goal (e.g. book a movie ticket) within a closed domain. A first step is to understand the user's goal by …
Deep Reinforcement LearningGoal-Oriented Dialogue SystemsNatural Language UnderstandingReinforcement Learning+2Agreement Tracking for Multi-Issue Negotiation Dialogues
Automated negotiation support systems aim to help human negotiators reach more favorable outcomes in multi-issue negotiations (e.g., an employer and a candidate negotiating over issues such as salary, hours, and promotio…
Transfer LearningOn Chatbots Exhibiting Goal-Directed Autonomy in Dynamic Environments
Conversation interfaces (CIs), or chatbots, are a popular form of intelligent agents that engage humans in task-oriented or informal conversation. In this position paper and demonstration, we argue that chatbots working …
PositionMultimodal Hierarchical Reinforcement Learning Policy for Task-Oriented Visual Dialog
Creating an intelligent conversational system that understands vision and language is one of the ultimate goals in Artificial Intelligence (AI)~\cite{winograd1972understanding}. Extensive research has focused on vision-t…
Hierarchical Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2