paper-with-me

Papers

Continual Dialogue State Tracking via Example-Guided Question Answering

2023-05-23 · Hyundong Cho, Andrea Madotto, Zhaojiang Lin, Khyathi Raghavi Chandu, Satwik Kottur, Jing Xu, Jonathan May, Chinnadhurai Sankar

Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services in diminishing performance on previously learnt services. Motivated by the insight that dialogue state tracking (DST), a crucial component of dialogue systems that estimates the user's goal as a conversation proceeds, is a simple natural language understanding task, we propose reformulating it as a bundle of granular example-guided question answering tasks to minimize the task shift between services and thus benefit continual learning. Our approach alleviates service-specific memorization and teaches a model to contextualize the given question and example to extract the necessary information from the conversation. We find that a model with just 60M parameters can achieve a significant boost by learning to learn from in-context examples retrieved by a retriever trained to identify turns with similar dialogue state changes. Combining our method with dialogue-level memory replay, our approach attains state of the art performance on DST continual learning metrics without relying on any complex regularization or parameter expansion methods.

📄 PDF Abstract BibTeX arXiv:2305.13721

Code (1)

facebookresearch/dst-egqa 공식 구현 pytorch

Tasks

Continual LearningDialogue State TrackingMemorizationNatural Language UnderstandingQuestion Answering

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Similar Papers 제목 키워드 기반

Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue

2022-04-08 · Raghav Gupta, Harrison Lee, Jeffrey Zhao, Abhinav Rastogi 외

Building universal dialogue systems that operate across multiple domains/APIs and generalize to new ones with minimal overhead is a critical challenge. Recent works have leveraged natural language descriptions of schema …

Dialogue State TrackingZero-shot Generalization

Show, Don’t Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue

2022-07-01 · NAACL 2022 7 · Raghav Gupta, Harrison Lee, Jeffrey Zhao, Yuan Cao 외

Building universal dialogue systems that operate across multiple domains/APIs and generalize to new ones with minimal overhead is a critical challenge. Recent works have leveraged natural language descriptions of schema …

Dialogue State TrackingZero-shot Generalization

Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation Networks

2021-11-01 · EMNLP 2021 11 · Qingbin Liu, Pengfei Cao, Cao Liu, Jiansong Chen 외

Dialogue state tracking (DST), which estimates user goals given a dialogue context, is an essential component of task-oriented dialogue systems. Conventional DST models are usually trained offline, which requires a fixed…

Dialogue State TrackingDiversityKnowledge DistillationLifelong learning+1

Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Building universal dialogue systems that can seamlessly operate across multiple domains/APIs and can generalize to new ones with minimal supervision and low maintenance is a critical challenge. Recent works have leverage…

Dialogue State Tracking

The SPPD System for Schema Guided Dialogue State Tracking Challenge

2020-06-16 · Miao Li, Haoqi Xiong, Yunbo Cao

This paper introduces one of our group's work on the Dialog System Technology Challenges 8 (DSTC8), the SPPD system for Schema Guided dialogue state tracking challenge. This challenge, named as Track 4 in DSTC8, provides…

Dialogue State TrackingMulti-domain Dialogue State Tracking