paper-with-me

Papers

Code-Switching Detection Using ASR-Generated Language Posteriors

2019-06-19 · Qinyi Wang, Emre Yilmaz, Adem Derinel, Haizhou Li

Code-switching (CS) detection refers to the automatic detection of language switches in code-mixed utterances. This task can be achieved by using a CS automatic speech recognition (ASR) system that can handle such language switches. In our previous work, we have investigated the code-switching detection performance of the Frisian-Dutch CS ASR system by using the time alignment of the most likely hypothesis and found that this technique suffers from over-switching due to numerous very short spurious language switches. In this paper, we propose a novel method for CS detection aiming to remedy this shortcoming by using the language posteriors which are the sum of the frame-level posteriors of phones belonging to the same language. The CS ASR-generated language posteriors contain more complete language-specific information on frame level compared to the time alignment of the ASR output. Hence, it is expected to yield more accurate and robust CS detection. The CS detection experiments demonstrate that the proposed language posterior-based approach provides higher detection accuracy than the baseline system in terms of equal error rate. Moreover, a detailed CS detection error analysis reveals that using language posteriors reduces the false alarms and results in more robust CS detection.

📄 PDF Abstract BibTeX arXiv:1906.08003

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injection

2024-11-26 · Tzu-Ting Yang, Hsin-Wei Wang, Yi-Cheng Wang, Berlin Chen

Code-switching-where multilingual speakers alternately switch between languages during conversations-still poses significant challenges to end-to-end (E2E) automatic speech recognition (ASR) systems due to phenomena of b…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language IdentificationMixture-of-Experts+2

Enhancing Code-switching Speech Recognition with Interactive Language Biases

2023-09-29 · Hexin Liu, Leibny Paola Garcia, Xiangyu Zhang, Andy W. H. Khong 외

Languages usually switch within a multilingual speech signal, especially in a bilingual society. This phenomenon is referred to as code-switching (CS), making automatic speech recognition (ASR) challenging under a multil…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+2

Improving Code-switching Language Modeling with Artificially Generated Texts using Cycle-consistent Adversarial Networks

2021-12-12 · Chia-Yu Li, Ngoc Thang Vu

This paper presents our latest effort on improving Code-switching language models that suffer from data scarcity. We investigate methods to augment Code-switching training text data by artificially generating them. Concr…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+2

Reducing Language confusion for Code-switching Speech Recognition with Token-level Language Diarization

2022-10-26 · Hexin Liu, HaiHua Xu, Leibny Paola Garcia, Andy W. H. Khong 외

Code-switching (CS) refers to the phenomenon that languages switch within a speech signal and leads to language confusion for automatic speech recognition (ASR). This paper aims to address language confusion for improvin…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Streaming Bilingual End-to-End ASR model using Attention over Multiple Softmax

2024-01-22 · Aditya Patil, Vikas Joshi, Purvi Agrawal, Rupesh Mehta

Even with several advancements in multilingual modeling, it is challenging to recognize multiple languages using a single neural model, without knowing the input language and most multilingual models assume the availabil…