paper-with-me

Papers

CHAI: A CHatbot AI for Task-Oriented Dialogue with Offline Reinforcement Learning

2022-04-18 · NAACL 2022 7 · Siddharth Verma, Justin Fu, Mengjiao Yang, Sergey Levine

Conventionally, generation of natural language for dialogue agents may be viewed as a statistical learning problem: determine the patterns in human-provided data and generate appropriate responses with similar statistical properties. However, dialogue can also be regarded as a goal directed process, where speakers attempt to accomplish a specific task. Reinforcement learning (RL) algorithms are designed specifically for solving such goal-directed problems, but the most direct way to apply RL -- through trial-and-error learning in human conversations, -- is costly. In this paper, we study how offline reinforcement learning can instead be used to train dialogue agents entirely using static datasets collected from human speakers. Our experiments show that recently developed offline RL methods can be combined with language models to yield realistic dialogue agents that better accomplish task goals.

📄 PDF Abstract BibTeX arXiv:2204.08426

Code (2)

siddharthverma314/chai-naacl-2022 공식 구현 pytorch
yifeizhou02/archer pytorch

Tasks

ChatbotOffline RLreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

GoChat: Goal-oriented Chatbots with Hierarchical Reinforcement Learning

2020-05-24 · Jianfeng Liu, Feiyang Pan, Ling Luo

A chatbot that converses like a human should be goal-oriented (i.e., be purposeful in conversation), which is beyond language generation. However, existing dialogue systems often heavily rely on cumbersome hand-crafted r…

ChatbotHierarchical Reinforcement Learningreinforcement-learningReinforcement Learning+3

Towards Task-Oriented Dialogue in Mixed Domains

2019-09-05 · Tho Luong Chi, Phuong Le-Hong

This work investigates the task-oriented dialogue problem in mixed-domain settings. We study the effect of alternating between different domains in sequences of dialogue turns using two related state-of-the-art dialogue …

Chatbot

A Low-Cost, Controllable and Interpretable Task-Oriented Chatbot: With Real-World After-Sale Services as Example

2022-05-13 · Xiangyu Xi, Chenxu Lv, Yuncheng Hua, Wei Ye 외

Though widely used in industry, traditional task-oriented dialogue systems suffer from three bottlenecks: (i) difficult ontology construction (e.g., intents and slots); (ii) poor controllability and interpretability; (ii…

ChatbotTask-Oriented Dialogue Systems

Task-Oriented Dialogue with In-Context Learning

2024-02-19 · Tom Bocklisch, Thomas Werkmeister, Daksh Varshneya, Alan Nichol

We describe a system for building task-oriented dialogue systems combining the in-context learning abilities of large language models (LLMs) with the deterministic execution of business logic. LLMs are used to translate …

In-Context LearningNavigateTask-Oriented Dialogue Systems

Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot

2024-10-30 · Sejin Lee, Dongha Kim, Min Song

Goal-oriented chatbots are essential for automating user tasks, such as booking flights or making restaurant reservations. A key component of these systems is Dialogue State Tracking (DST), which interprets user intent a…

ChatbotDialogue State TrackingHallucinationLanguage Modeling+2