paper-with-me

Papers

Fast Intent Classification for Spoken Language Understanding

2019-12-03 · Akshit Tyagi, Varun Sharma, Rahul Gupta, Lynn Samson, Nan Zhuang, Zihang Wang, Bill Campbell

Spoken Language Understanding (SLU) systems consist of several machine learning components operating together (e.g. intent classification, named entity recognition and resolution). Deep learning models have obtained state of the art results on several of these tasks, largely attributed to their better modeling capacity. However, an increase in modeling capacity comes with added costs of higher latency and energy usage, particularly when operating on low complexity devices. To address the latency and computational complexity issues, we explore a BranchyNet scheme on an intent classification scheme within SLU systems. The BranchyNet scheme when applied to a high complexity model, adds exit points at various stages in the model allowing early decision making for a set of queries to the SLU model. We conduct experiments on the Facebook Semantic Parsing dataset with two candidate model architectures for intent classification. Our experiments show that the BranchyNet scheme provides gains in terms of computational complexity without compromising model accuracy. We also conduct analytical studies regarding the improvements in the computational cost, distribution of utterances that egress from various exit points and the impact of adding more complexity to models with the BranchyNet scheme.

📄 PDF Abstract BibTeX arXiv:1912.01728

Code (1)

akshittyagi/intclass 공식 구현 pytorch

Tasks

ClassificationDecision MakingGeneral Classificationintent-classificationIntent Classificationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Semantic ParsingSpoken Language Understanding

Methods 이 논문이 사용한 방법론

Early exiting Exit whenever the model is confident enough allowing early exiting from hidden layers

Similar Papers 제목 키워드 기반

Finstreder: Simple and fast Spoken Language Understanding with Finite State Transducers using modern Speech-to-Text models

2022-06-29 · Daniel Bermuth, Alexander Poeppel, Wolfgang Reif

In Spoken Language Understanding (SLU) the task is to extract important information from audio commands, like the intent of what a user wants the system to do and special entities like locations or numbers. This paper pr…

Intent ClassificationSlot FillingSpeech-to-TextSpoken Language Understanding

From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding

2021-05-15 · NAACL 2021 4 · Rob van der Goot, Ibrahim Sharaf, Aizhan Imankulova, Ahmet Üstün 외

The lack of publicly available evaluation data for low-resource languages limits progress in Spoken Language Understanding (SLU). As key tasks like intent classification and slot filling require abundant training data, i…

intent-classificationIntent ClassificationIntent DetectionLanguage Modeling+6

A BiRGAT Model for Multi-intent Spoken Language Understanding with Hierarchical Semantic Frames

2024-02-28 · Hongshen Xu, Ruisheng Cao, Su Zhu, Sheng Jiang 외

Previous work on spoken language understanding (SLU) mainly focuses on single-intent settings, where each input utterance merely contains one user intent. This configuration significantly limits the surface form of user …

DecoderGraph AttentionSpoken Language Understanding

On Building Spoken Language Understanding Systems for Low Resourced Languages

2022-05-25 · NAACL (SIGMORPHON) 2022 7 · Akshat Gupta

Spoken dialog systems are slowly becoming and integral part of the human experience due to their various advantages over textual interfaces. Spoken language understanding (SLU) systems are fundamental building blocks of …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)intent-classificationIntent Classification+3

Intent Recognition and Unsupervised Slot Identification for Low Resourced Spoken Dialog Systems

2021-04-03 · Akshat Gupta, Olivia Deng, Akruti Kushwaha, Saloni Mittal 외

Intent Recognition and Slot Identification are crucial components in spoken language understanding (SLU) systems. In this paper, we present a novel approach towards both these tasks in the context of low resourced and un…

Data AugmentationGeneral Classificationintent-classificationIntent Classification+3