paper-with-me

Papers

A Hierarchical Decoding Model For Spoken Language Understanding From Unaligned Data

2019-04-09 · Zijian Zhao, Su Zhu, Kai Yu

Spoken language understanding (SLU) systems can be trained on two types of labelled data: aligned or unaligned. Unaligned data do not require word by word annotation and is easier to be obtained. In the paper, we focus on spoken language understanding from unaligned data whose annotation is a set of act-slot-value triples. Previous works usually focus on improve slot-value pair prediction and estimate dialogue act types separately, which ignores the hierarchical structure of the act-slot-value triples. Here, we propose a novel hierarchical decoding model which dynamically parses act, slot and value in a structured way and employs pointer network to handle out-of-vocabulary (OOV) values. Experiments on DSTC2 dataset, a benchmark unaligned dataset, show that the proposed model not only outperforms previous state-of-the-art model, but also can be generalized effectively and efficiently to unseen act-slot type pairs and OOV values.

📄 PDF Abstract BibTeX arXiv:1904.04498

Code (1)

simplc/WCN-BERT pytorch

Tasks

Spoken Language Understanding

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
[LivE@PeRson]How do I talk to a real person at Expedia? How do I talk to a real person at Expedia? To speak with a live Expedia agent, call 1 (888) 829-0881 anytime. The customer support team is available 24/7 to help with…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Pointer Network Pointer Networks tackle problems where input and output data are sequential data, but can't be solved by seq2seq type models because discrete categories of output elements…

Similar Papers 제목 키워드 기반

Graph-Based Semi-Supervised Conditional Random Fields For Spoken Language Understanding Using Unaligned Data

2017-01-30 · ALTA 2014 11 · Mohammad Aliannejadi, Masoud Kiaeeha, Shahram Khadivi, Saeed Shiry Ghidary

We experiment graph-based Semi-Supervised Learning (SSL) of Conditional Random Fields (CRF) for the application of Spoken Language Understanding (SLU) on unaligned data. The aligned labels for examples are obtained using…

Spoken Language Understanding

Exploiting Sentence and Context Representations in Deep Neural Models for Spoken Language Understanding

2016-10-13 · COLING 2016 12 · Lina M. Rojas Barahona, Milica Gasic, Nikola Mrkšić, Pei-Hao Su 외

This paper presents a deep learning architecture for the semantic decoder component of a Statistical Spoken Dialogue System. In a slot-filling dialogue, the semantic decoder predicts the dialogue act and a set of slot-va…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderRepresentation Learning+6

Design and development of an RDB version of the Corpus of Spontaneous Japanese

2014-05-01 · LREC 2014 5 · Hanae Koiso, Yasuharu Den, Ken{'}ya Nishikawa, Kikuo Maekawa

In this paper, we describe the design and development of a new version of the Corpus of Spontaneous Japanese (CSJ), which is a large-scale spoken corpus released in 2004. CSJ contains various annotations that are represe…

Semantic Refinement GRU-based Neural Language Generation for Spoken Dialogue Systems

2017-06-01 · Van-Khanh Tran, Le-Minh Nguyen

Natural language generation (NLG) plays a critical role in spoken dialogue systems. This paper presents a new approach to NLG by using recurrent neural networks (RNN), in which a gating mechanism is applied before RNN co…

SentenceSpoken Dialogue SystemsText Generation

Natural Language Generation by Hierarchical Decoding with Linguistic Patterns

2018-08-08 · NAACL 2018 6 · Shang-Yu Su, Kai-Ling Lo, Yi-Ting Yeh, Yun-Nung Chen

Natural language generation (NLG) is a critical component in spoken dialogue systems. Classic NLG can be divided into two phases: (1) sentence planning: deciding on the overall sentence structure, (2) surface realization…

DecoderSentenceSpoken Dialogue SystemsText Generation