paper-with-me

Papers

Where are we in semantic concept extraction for Spoken Language Understanding?

2021-06-24 · Sahar Ghannay, Antoine Caubrière, Salima Mdhaffar, Gaëlle Laperrière, Bassam Jabaian, Yannick Estève

Spoken language understanding (SLU) topic has seen a lot of progress these last three years, with the emergence of end-to-end neural approaches. Spoken language understanding refers to natural language processing tasks related to semantic extraction from speech signal, like named entity recognition from speech or slot filling task in a context of human-machine dialogue. Classically, SLU tasks were processed through a cascade approach that consists in applying, firstly, an automatic speech recognition process, followed by a natural language processing module applied to the automatic transcriptions. These three last years, end-to-end neural approaches, based on deep neural networks, have been proposed in order to directly extract the semantics from speech signal, by using a single neural model. More recent works on self-supervised training with unlabeled data open new perspectives in term of performance for automatic speech recognition and natural language processing. In this paper, we present a brief overview of the recent advances on the French MEDIA benchmark dataset for SLU, with or without the use of additional data. We also present our last results that significantly outperform the current state-of-the-art with a Concept Error Rate (CER) of 11.2%, instead of 13.6% for the last state-of-the-art system presented this year.

📄 PDF Abstract BibTeX arXiv:2106.13045

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)slot-fillingSlot Fillingspeech-recognitionSpeech RecognitionSpoken Language Understanding

Similar Papers 제목 키워드 기반

ConceptBeam: Concept Driven Target Speech Extraction

2022-07-25 · Yasunori Ohishi, Marc Delcroix, Tsubasa Ochiai, Shoko Araki 외

We propose a novel framework for target speech extraction based on semantic information, called ConceptBeam. Target speech extraction means extracting the speech of a target speaker in a mixture. Typical approaches have …

Metric LearningSpeech Extraction

Is one brick enough to break the wall of spoken dialogue state tracking?

2023-11-03 · Lucas Druart, Valentin Vielzeuf, Yannick Estève

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's requests (\textit{a.k.a} dialogue state tracking) is key to a smooth interaction. Traditionally, TOD systems perform th…

Dialogue State Tracking

Learnt Contrastive Concept Embeddings for Sign Recognition

2023-08-18 · Ryan Wong, Necati Cihan Camgoz, Richard Bowden

In natural language processing (NLP) of spoken languages, word embeddings have been shown to be a useful method to encode the meaning of words. Sign languages are visual languages, which require sign embeddings to captur…

Word Embeddings

A Data Efficient End-To-End Spoken Language Understanding Architecture

2020-02-14 · Marco Dinarelli, Nikita Kapoor, Bassam Jabaian, Laurent Besacier

End-to-end architectures have been recently proposed for spoken language understanding (SLU) and semantic parsing. Based on a large amount of data, those models learn jointly acoustic and linguistic-sequential features. …

ChunkingLanguage ModelingLanguage ModellingSemantic Parsing+1

Dialogue history integration into end-to-end signal-to-concept spoken language understanding systems

2020-02-14 · Natalia Tomashenko, Christian Raymond, Antoine Caubriere, Renato de Mori 외

This work investigates the embeddings for representing dialog history in spoken language understanding (SLU) systems. We focus on the scenario when the semantic information is extracted directly from the speech signal by…

slot-fillingSlot FillingSpoken Language Understanding