paper-with-me

홈 › Papers

Integrating Dialog History into End-to-End Spoken Language Understanding Systems

2021-08-18 · Jatin Ganhotra, Samuel Thomas, Hong-Kwang J. Kuo, Sachindra Joshi, George Saon, Zoltán Tüske, Brian Kingsbury

End-to-end spoken language understanding (SLU) systems that process human-human or human-computer interactions are often context independent and process each turn of a conversation independently. Spoken conversations on the other hand, are very much context dependent, and dialog history contains useful information that can improve the processing of each conversational turn. In this paper, we investigate the importance of dialog history and how it can be effectively integrated into end-to-end SLU systems. While processing a spoken utterance, our proposed RNN transducer (RNN-T) based SLU model has access to its dialog history in the form of decoded transcripts and SLU labels of previous turns. We encode the dialog history as BERT embeddings, and use them as an additional input to the SLU model along with the speech features for the current utterance. We evaluate our approach on a recently released spoken dialog data set, the HarperValleyBank corpus. We observe significant improvements: 8% for dialog action and 30% for caller intent recognition tasks, in comparison to a competitive context independent end-to-end baseline system.

📄 PDF Abstract BibTeX arXiv:2108.08405

Code (0)

등록된 구현이 없습니다.

Tasks

Intent RecognitionSpoken Language Understanding

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
WordPiece 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Data Augmentation Integrating Dialogue Flow and Style to Adapt Spoken Dialogue Systems to Low-Resource User Groups

2024-08-20 · Zhiyang Qi, Michimasa Inaba

This study addresses the interaction challenges encountered by spoken dialogue systems (SDSs) when engaging with users who exhibit distinct conversational behaviors, particularly minors, in scenarios where data are scarc…

Data AugmentationLanguage ModelingLanguage ModellingLarge Language Model+1

Sequential Dialogue Context Modeling for Spoken Language Understanding

2017-05-08 · WS 2017 8 · Ankur Bapna, Gokhan Tur, Dilek Hakkani-Tur, Larry Heck

Spoken Language Understanding (SLU) is a key component of goal oriented dialogue systems that would parse user utterances into semantic frame representations. Traditionally SLU does not utilize the dialogue history beyon…

Goal-Oriented Dialogue SystemsSpoken Language Understanding

Dialogue history integration into end-to-end signal-to-concept spoken language understanding systems

2020-02-14 · Natalia Tomashenko, Christian Raymond, Antoine Caubriere, Renato de Mori 외

This work investigates the embeddings for representing dialog history in spoken language understanding (SLU) systems. We focus on the scenario when the semantic information is extracted directly from the speech signal by…

slot-fillingSlot FillingSpoken Language Understanding

An Efficient Approach to Encoding Context for Spoken Language Understanding

2018-07-01 · Raghav Gupta, Abhinav Rastogi, Dilek Hakkani-Tur

In task-oriented dialogue systems, spoken language understanding, or SLU, refers to the task of parsing natural language user utterances into semantic frames. Making use of context from prior dialogue history holds the k…

Computational EfficiencySpoken Language UnderstandingTask-Oriented Dialogue Systems

Towards End-to-End Integration of Dialog History for Improved Spoken Language Understanding

2022-04-11 · Vishal Sunder, Samuel Thomas, Hong-Kwang J. Kuo, Jatin Ganhotra 외

Dialog history plays an important role in spoken language understanding (SLU) performance in a dialog system. For end-to-end (E2E) SLU, previous work has used dialog history in text form, which makes the model dependent …

Action RecognitionSpoken Language Understanding