Towards end-to-end spoken language understanding
Spoken language understanding system is traditionally designed as a pipeline of a number of components. First, the audio signal is processed by an automatic speech recognizer for transcription or n-best hypotheses. With the recognition results, a natural language understanding system classifies the text to structured data as domain, intent and slots for down-streaming consumers, such as dialog system, hands-free applications. These components are usually developed and optimized independently. In this paper, we present our study on an end-to-end learning system for spoken language understanding. With this unified approach, we can infer the semantic meaning directly from audio features without the intermediate text representation. This study showed that the trained model can achieve reasonable good result and demonstrated that the model can capture the semantic attention directly from the audio features.
Code (1)
Tasks
Natural Language UnderstandingSpoken Language UnderstandingSimilar Papers 제목 키워드 기반
MTL-SLT: Multi-Task Learning for Spoken Language Tasks
Language understanding in speech-based systems has attracted extensive interest from both academic and industrial communities in recent years with the growing demand for voice-based applications. Prior works focus on ind…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModellingMulti-Task Learning+4A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
The objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation. The Spoken2Sign task is orthogonal and complementary to traditio…
Sign Language TranslationTranslationPre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning
In the traditional cascading architecture for spoken language understanding (SLU), it has been observed that automatic speech recognition errors could be detrimental to the performance of natural language understanding. …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+6Learning from limited datasets: Implications for Natural Language Generation and Human-Robot Interaction
One of the most natural ways for human robot communication is through spoken language. Training human-robot interaction systems require access to large datasets which are expensive to obtain and labour intensive. In this…
One-Shot LearningSpoken Dialogue SystemsText GenerationAn Adversarial Learning based Multi-Step Spoken Language Understanding System through Human-Computer Interaction
Most of the existing spoken language understanding systems can perform only semantic frame parsing based on a single-round user query. They cannot take users' feedback to update/add/remove slot values through multiround …
Dialogue State TrackingSemantic Frame ParsingSentenceSpoken Language Understanding