Dialogue manager domain adaptation using Gaussian process reinforcement learning
Spoken dialogue systems allow humans to interact with machines using natural speech. As such, they have many benefits. By using speech as the primary communication medium, a computer interface can facilitate swift, human-like acquisition of information. In recent years, speech interfaces have become ever more popular, as is evident from the rise of personal assistants such as Siri, Google Now, Cortana and Amazon Alexa. Recently, data-driven machine learning methods have been applied to dialogue modelling and the results achieved for limited-domain applications are comparable to or outperform traditional approaches. Methods based on Gaussian processes are particularly effective as they enable good models to be estimated from limited training data. Furthermore, they provide an explicit estimate of the uncertainty which is particularly useful for reinforcement learning. This article explores the additional steps that are necessary to extend these methods to model multiple dialogue domains. We show that Gaussian process reinforcement learning is an elegant framework that naturally supports a range of methods, including prior knowledge, Bayesian committee machines and multi-agent learning, for facilitating extensible and adaptable dialogue systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationGaussian Processesreinforcement-learningReinforcement LearningReinforcement Learning (RL)Spoken Dialogue SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
POMDP-based dialogue manager adaptation to extended domains
MME-RAG: Multi-Manager-Expert Retrieval-Augmented Generation for Fine-Grained Entity Recognition in Task-Oriented Dialogues
Fine-grained entity recognition is crucial for reasoning and decision-making in task-oriented dialogues, yet current large language models (LLMs) continue to face challenges in domain adaptation and retrieval controllabi…
Domain GeneralizationDomain AdaptationAn Ontology-Based Dialogue Management System for Banking and Finance Dialogue Systems
Keeping the dialogue state in dialogue systems is a notoriously difficult task. We introduce an ontology-based dialogue manage(OntoDM), a dialogue manager that keeps the state of the conversation, provides a basis for an…
ChatbotDialogue ManagementManagementSpecificityInformation Navigation System with Discovering User Interests
We demonstrate an information navigation system for sightseeing domains that has a dialogue interface for discovering user interests for tourist activities. The system discovers interests of a user with focus detection o…
Semantic Textual SimilaritySpeech RecognitionMeta-Reinforced Multi-Domain State Generator for Dialogue Systems
A Dialogue State Tracker (DST) is a core component of a modular task-oriented dialogue system. Tremendous progress has been made in recent years. However, the major challenges remain. The state-of-the-art accuracy for DS…
Domain AdaptationMeta-LearningReinforcement Learning (RL)