Deep Reinforcement Learning for On-line Dialogue State Tracking

2020-09-22 · Zhi Chen, Lu Chen, Xiang Zhou, Kai Yu

Dialogue state tracking (DST) is a crucial module in dialogue management. It is usually cast as a supervised training problem, which is not convenient for on-line optimization. In this paper, a novel companion teaching based deep reinforcement learning (DRL) framework for on-line DST optimization is proposed. To the best of our knowledge, this is the first effort to optimize the DST module within DRL framework for on-line task-oriented spoken dialogue systems. In addition, dialogue policy can be further jointly updated. Experiments show that on-line DST optimization can effectively improve the dialogue manager performance while keeping the flexibility of using predefined policy. Joint training of both DST and policy can further improve the performance.

📄 PDF Abstract BibTeX arXiv:2009.10321

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningDialogue ManagementDialogue State Tracking Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Spoken Dialogue Systems

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Distributed Structured Actor-Critic Reinforcement Learning for Universal Dialogue Management

2020-09-22 · Zhi Chen, Lu Chen, Xiaoyuan Liu, Kai Yu

The task-oriented spoken dialogue system (SDS) aims to assist a human user in accomplishing a specific task (e.g., hotel booking). The dialogue management is a core part of SDS. There are two main missions in dialogue ma…

Decision Making Deep Reinforcement Learning Dialogue Management Management+3

End-to-End Optimization of Task-Oriented Dialogue Model with Deep Reinforcement Learning

2017-11-29 · Bing Liu, Gokhan Tur, Dilek Hakkani-Tur, Pararth Shah 외

In this paper, we present a neural network based task-oriented dialogue system that can be optimized end-to-end with deep reinforcement learning (RL). The system is able to track dialogue state, interface with knowledge …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Explicit State Tracking with Semi-Supervision for Neural Dialogue Generation

2018-08-31 · Xisen Jin, Wenqiang Lei, Zhaochun Ren, Hongshen Chen 외

The task of dialogue generation aims to automatically provide responses given previous utterances. Tracking dialogue states is an important ingredient in dialogue generation for estimating users' intention. However, the …

Decoder Dialogue Generation Dialogue State Tracking

Multimodal Dialogue State Tracking

2022-06-16 · NAACL 2022 7 · Hung Le, Nancy F. Chen, Steven C. H. Hoi

Designed for tracking user goals in dialogues, a dialogue state tracker is an essential component in a dialogue system. However, the research of dialogue state tracking has largely been limited to unimodality, in which s…

Dialogue State Tracking Video Understanding

The SPPD System for Schema Guided Dialogue State Tracking Challenge

2020-06-16 · Miao Li, Haoqi Xiong, Yunbo Cao

This paper introduces one of our group's work on the Dialog System Technology Challenges 8 (DSTC8), the SPPD system for Schema Guided dialogue state tracking challenge. This challenge, named as Track 4 in DSTC8, provides…

Dialogue State Tracking Multi-domain Dialogue State Tracking