paper-with-me

홈 › Papers

Unsupervised Spoken Utterance Classification

2021-07-02 · Shahab Jalalvand, Srinivas Bangalore

An intelligent virtual assistant (IVA) enables effortless conversations in call routing through spoken utterance classification (SUC) which is a special form of spoken language understanding (SLU). Building a SUC system requires a large amount of supervised in-domain data that is not always available. In this paper, we introduce an unsupervised spoken utterance classification approach (USUC) that does not require any in-domain data except for the intent labels and a few para-phrases per intent. USUC is consisting of a KNN classifier (K=1) and a complex embedding model trained on a large amount of unsupervised customer service corpus. Among all embedding models, we demonstrate that Elmo works best for USUC. However, an Elmo model is too slow to be used at run-time for call routing. To resolve this issue, first, we compute the uni- and bi-gram embedding vectors offline and we build a lookup table of n-grams and their corresponding embedding vector. Then we use this table to compute sentence embedding vectors at run-time, along with back-off techniques for unseen n-grams. Experiments show that USUC outperforms the traditional utterance classification methods by reducing the classification error rate from 32.9% to 27.0% without requiring supervised data. Moreover, our lookup and back-off technique increases the processing speed from 16 utterances per second to 118 utterances per second.

📄 PDF Abstract BibTeX arXiv:2107.01068

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationSentenceSentence EmbeddingSentence-EmbeddingSpoken Language Understanding

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
BiLSTM A Bidirectional LSTM, or biLSTM, is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
ELMo Embeddings from Language Models, or ELMo, is a type of deep contextualized word representation that models both (1) complex characteristics of word use (e.g., syntax and…

Similar Papers 제목 키워드 기반

Segmental Audio Word2Vec: Representing Utterances as Sequences of Vectors with Applications in Spoken Term Detection

2018-08-07 · Yu-Hsuan Wang, Hung-Yi Lee, Lin-shan Lee

While Word2Vec represents words (in text) as vectors carrying semantic information, audio Word2Vec was shown to be able to represent signal segments of spoken words as vectors carrying phonetic structure information. Aud…

Reinforcement LearningSegmentation

Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent Agents

2018-11-13 · Aditya Siddhant, Anuj Goyal, Angeliki Metallinou

User interaction with voice-powered agents generates large amounts of unlabeled utterances. In this paper, we explore techniques to efficiently transfer the knowledge from these unlabeled utterances to improve model perf…

Language ModelingLanguage ModellingSpoken Language UnderstandingTransfer Learning+1

Summarizing Decisions in Spoken Meetings

2016-06-25 · Lu Wang, Claire Cardie

This paper addresses the problem of summarizing decisions in spoken meetings: our goal is to produce a concise {\it decision abstract} for each meeting decision. We explore and compare token-level and dialogue act-level …

Topic Models

On the difficulty of a distributional semantics of spoken language

2018-03-23 · WS 2019 1 · Grzegorz Chrupała, Lieke Gelderloos, Ákos Kádár, Afra Alishahi

In the domain of unsupervised learning most work on speech has focused on discovering low-level constructs such as phoneme inventories or word-like units. In contrast, for written language, where there is a large body of…

Unsupervised Topic Modeling Approaches to Decision Summarization in Spoken Meetings

2016-06-24 · WS 2012 7 · Lu Wang, Claire Cardie

We present a token-level decision summarization framework that utilizes the latent topic structures of utterances to identify "summary-worthy" words. Concretely, a series of unsupervised topic models is explored and expe…

Decision MakingTopic Models