Towards End-to-end Automatic Code-Switching Speech Recognition

2018-10-30 · Genta Indra Winata, Andrea Madotto, Chien-Sheng Wu, Pascale Fung

Speech recognition in mixed language has difficulties to adapt end-to-end framework due to the lack of data and overlapping phone sets, for example in words such as "one" in English and "w\`an" in Chinese. We propose a CTC-based end-to-end automatic speech recognition model for intra-sentential English-Mandarin code-switching. The model is trained by joint training on monolingual datasets, and fine-tuning with the mixed-language corpus. During the decoding process, we apply a beam search and combine CTC predictions and language model score. The proposed method is effective in leveraging monolingual corpus and detecting language transitions and it improves the CER by 5%.

📄 PDF Abstract BibTeX arXiv:1810.12620

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling speech-recognition Speech Recognition

Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challenge

2022-10-12 · Shuhao Deng, Chengfei Li, Jinfeng Bai, Qingqing Zhang 외

Code-switching automatic speech recognition becomes one of the most challenging and the most valuable scenarios of automatic speech recognition, due to the code-switching phenomenon between multilingual language and the …

Automatic Speech Recognition Automatic Speech Recognition (ASR)speech-recognition Speech Recognition

Benchmarking Evaluation Metrics for Code-Switching Automatic Speech Recognition

2022-11-22 · Injy Hamed, Amir Hussein, Oumnia Chellah, Shammur Chowdhury 외

Code-switching poses a number of challenges and opportunities for multilingual automatic speech recognition. In this paper, we focus on the question of robust and fair evaluation metrics. To that end, we develop a refere…

Automatic Speech Recognition Automatic Speech Recognition (ASR)Benchmarking speech-recognition+3

Towards End-to-End Code-Switching Speech Recognition

2018-10-31 · Ne Luo, Dongwei Jiang, Shuaijiang Zhao, Caixia Gong 외

Code-switching speech recognition has attracted an increasing interest recently, but the need for expert linguistic knowledge has always been a big issue. End-to-end automatic speech recognition (ASR) simplifies the buil…

Automatic Speech Recognition Automatic Speech Recognition (ASR)Language Identification speech-recognition+1

Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review

2025-07-10 · Maha Tufail Agro, Atharva Kulkarni, Karima Kadaoui, Zeerak Talat 외 arxiv

Motivated by a growing research interest into automatic speech recognition (ASR), and the growing body of work for languages in which code-switching (CS) often occurs, we present a systematic literature review of code-sw…

Speech Recognition

Mandarin-English Code-Switching Speech Recognition System for Specific Domain

2022-11-01 · ROCLING 2022 11 · Chung-Pu Chiou, Hou-An Lin, Chia-Ping Chen

This paper will introduce the use of Automatic Speech Recognition (ASR) technology to process speech content with specific domain. We will use the Conformer end-to-end model as the system architecture, and use pure Chine…

Automatic Speech Recognition Automatic Speech Recognition (ASR)speech-recognition Speech Recognition+1