paper-with-me

Papers

Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11

2023-04-25 · James Gung, Raphael Shu, Emily Moeng, Wesley Rose, Salvatore Romeo, Yassine Benajiba, Arshit Gupta, Saab Mansour, Yi Zhang

With increasing demand for and adoption of virtual assistants, recent work has investigated ways to accelerate bot schema design through the automatic induction of intents or the induction of slots and dialogue states. However, a lack of dedicated benchmarks and standardized evaluation has made progress difficult to track and comparisons between systems difficult to make. This challenge track, held as part of the Eleventh Dialog Systems Technology Challenge, introduces a benchmark that aims to evaluate methods for the automatic induction of customer intents in a realistic setting of customer service interactions between human agents and customers. We propose two subtasks for progressively tackling the automatic induction of intents and corresponding evaluation methodologies. We then present three datasets suitable for evaluating the tasks and propose simple baselines. Finally, we summarize the submissions and results of the challenge track, for which we received submissions from 34 teams.

📄 PDF Abstract BibTeX arXiv:2304.12982

Code (2)

amazon-science/dstc11-track2-intent-induction 공식 구현
amazon-research/dstc11-track2-intent-induction

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

Multi-Stage Coarse-to-Fine Contrastive Learning for Conversation Intent Induction

2023-03-09 · Caiyuan Chu, Ya Li, Yifan Liu, Jia-Chen Gu 외

Intent recognition is critical for task-oriented dialogue systems. However, for emerging domains and new services, it is difficult to accurately identify the key intent of a conversation due to time-consuming data annota…

ClusteringContrastive LearningIntent RecognitionSentence+1

Adapting Task-Oriented Dialogue Models for Email Conversations

2022-08-19 · Soham Deshmukh, Charles Lee

Intent detection is a key part of any Natural Language Understanding (NLU) system of a conversational assistant. Detecting the correct intent is essential yet difficult for email conversations where multiple directives a…

Intent DetectionNatural Language UnderstandingTransfer Learning

NatCS: Eliciting Natural Customer Support Dialogues

2023-05-04 · James Gung, Emily Moeng, Wesley Rose, Arshit Gupta 외

Despite growing interest in applications based on natural customer support conversations, there exist remarkably few publicly available datasets that reflect the expected characteristics of conversations in these setting…

Dialogue Act Classification

Analysis of Utterance Embeddings and Clustering Methods Related to Intent Induction for Task-Oriented Dialogue

2022-12-05 · Jeiyoon Park, Yoonna Jang, Chanhee Lee, Heuiseok Lim

The focus of this work is to investigate unsupervised approaches to overcome quintessential challenges in designing task-oriented dialog schema: assigning intent labels to each dialog turn (intent clustering) and generat…

Clustering

Multi-View Zero-Shot Open Intent Induction from Dialogues: Multi Domain Batch and Proxy Gradient Transfer

2023-03-23 · Hyukhun Koh, Haesung Pyun, Nakyeong Yang, Kyomin Jung

In Task Oriented Dialogue (TOD) system, detecting and inducing new intents are two main challenges to apply the system in the real world. In this paper, we suggest the semantic multi-view model to resolve these two chall…