paper-with-me

홈 › Papers

Improving Long Distance Slot Carryover in Spoken Dialogue Systems

2019-06-04 · WS 2019 8 · Tongfei Chen, Chetan Naik, Hua He, Pushpendre Rastogi, Lambert Mathias

Tracking the state of the conversation is a central component in task-oriented spoken dialogue systems. One such approach for tracking the dialogue state is slot carryover, where a model makes a binary decision if a slot from the context is relevant to the current turn. Previous work on the slot carryover task used models that made independent decisions for each slot. A close analysis of the results show that this approach results in poor performance over longer context dialogues. In this paper, we propose to jointly model the slots. We propose two neural network architectures, one based on pointer networks that incorporate slot ordering information, and the other based on transformer networks that uses self attention mechanism to model the slot interdependencies. Our experiments on an internal dialogue benchmark dataset and on the public DSTC2 dataset demonstrate that our proposed models are able to resolve longer distance slot references and are able to achieve competitive performance.

📄 PDF Abstract BibTeX arXiv:1906.01149

Code (0)

등록된 구현이 없습니다.

Tasks

Spoken Dialogue Systems

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Attentive Contextual Carryover for Multi-Turn End-to-End Spoken Language Understanding

2021-12-13 · Kai Wei, Thanh Tran, Feng-Ju Chang, Kanthashree Mysore Sathyendra 외

Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improv…

Natural Language UnderstandingSpoken Language Understanding

Time Masking: Leveraging Temporal Information in Spoken Dialogue Systems

2019-07-25 · WS 2019 9 · Rylan Conway, Lambert Mathias

In a spoken dialogue system, dialogue state tracker (DST) components track the state of the conversation by updating a distribution of values associated with each of the slots being tracked for the current user turn, usi…

Spoken Dialogue SystemsVideo Salient Object Detection

The SPPD System for Schema Guided Dialogue State Tracking Challenge

2020-06-16 · Miao Li, Haoqi Xiong, Yunbo Cao

This paper introduces one of our group's work on the Dialog System Technology Challenges 8 (DSTC8), the SPPD system for Schema Guided dialogue state tracking challenge. This challenge, named as Track 4 in DSTC8, provides…

Dialogue State TrackingMulti-domain Dialogue State Tracking

Adapting Text-based Dialogue State Tracker for Spoken Dialogues

2023-08-29 · Jaeseok Yoon, Seunghyun Hwang, Ran Han, Jeonguk Bang 외

Although there have been remarkable advances in dialogue systems through the dialogue systems technology competition (DSTC), it remains one of the key challenges to building a robust task-oriented dialogue system with a …

Automatic Speech RecognitionData Augmentationspeech-recognitionSpeech Recognition

SpokenUS: A Spoken User Simulator for Task-Oriented Dialogue

2026-03-17 · Jonggeun Lee, Junseong Pyo, Jeongmin Park, Yohan Jo arxiv

Robust task-oriented spoken dialogue agents require exposure to the full diversity of how people interact through speech. Building spoken user simulators that address this requires large-scale spoken task-oriented dialog…