paper-with-me

홈 › Papers

An Efficient Approach to Encoding Context for Spoken Language Understanding

2018-07-01 · Raghav Gupta, Abhinav Rastogi, Dilek Hakkani-Tur

In task-oriented dialogue systems, spoken language understanding, or SLU, refers to the task of parsing natural language user utterances into semantic frames. Making use of context from prior dialogue history holds the key to more effective SLU. State of the art approaches to SLU use memory networks to encode context by processing multiple utterances from the dialogue at each turn, resulting in significant trade-offs between accuracy and computational efficiency. On the other hand, downstream components like the dialogue state tracker (DST) already keep track of the dialogue state, which can serve as a summary of the dialogue history. In this work, we propose an efficient approach to encoding context from prior utterances for SLU. More specifically, our architecture includes a separate recurrent neural network (RNN) based encoding module that accumulates dialogue context to guide the frame parsing sub-tasks and can be shared between SLU and DST. In our experiments, we demonstrate the effectiveness of our approach on dialogues from two domains.

📄 PDF Abstract BibTeX arXiv:1807.00267

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencySpoken Language UnderstandingTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Similar Papers 제목 키워드 기반

Bidirectional Representations for Low Resource Spoken Language Understanding

2022-11-24 · Quentin Meeus, Marie-Francine Moens, Hugo Van hamme

Most spoken language understanding systems use a pipeline approach composed of an automatic speech recognition interface and a natural language understanding module. This approach forces hard decisions when converting co…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModellingNatural Language Understanding+3

Sequential Dialogue Context Modeling for Spoken Language Understanding

2017-05-08 · WS 2017 8 · Ankur Bapna, Gokhan Tur, Dilek Hakkani-Tur, Larry Heck

Spoken Language Understanding (SLU) is a key component of goal oriented dialogue systems that would parse user utterances into semantic frame representations. Traditionally SLU does not utilize the dialogue history beyon…

Goal-Oriented Dialogue SystemsSpoken Language Understanding

Jointly Encoding Word Confusion Network and Dialogue Context with BERT for Spoken Language Understanding

2020-05-24 · Chen Liu, Su Zhu, Zijian Zhao, Ruisheng Cao 외

Spoken Language Understanding (SLU) converts hypotheses from automatic speech recognizer (ASR) into structured semantic representations. ASR recognition errors can severely degenerate the performance of the subsequent SL…

Spoken Language Understanding

Adapting Pretrained Transformer to Lattices for Spoken Language Understanding

2020-11-02 · Chao-Wei Huang, Yun-Nung Chen

Lattices are compact representations that encode multiple hypotheses, such as speech recognition results or different word segmentations. It is shown that encoding lattices as opposed to 1-best results generated by autom…

Natural Language Understandingspeech-recognitionSpeech RecognitionSpoken Language Understanding

Transfer Learning for Context-Aware Spoken Language Understanding

2020-03-03 · Qian Chen, Zhu Zhuo, Wen Wang, Qiuyun Xu

Spoken language understanding (SLU) is a key component of task-oriented dialogue systems. SLU parses natural language user utterances into semantic frames. Previous work has shown that incorporating context information s…

Spoken Language UnderstandingTask-Oriented Dialogue SystemsTransfer LearningUnsupervised Pre-training