paper-with-me

Papers

Joint Language Identification of Code-Switching Speech using Attention based E2E Network

2019-07-15 · Sreeram Ganji, Kunal Dhawan, Kumar Priyadarshi, Rohit Sinha

Language identification (LID) has relevance in many speech processing applications. For the automatic recognition of code-switching speech, the conventional approaches often employ an LID system for detecting the languages present within an utterance. In the existing works, the LID on code-switching speech involves modelling of the underlying languages separately. In this work, we propose a joint modelling based LID system for code-switching speech. To achieve the same, an attention-based end-to-end (E2E) network has been explored. For the development and evaluation of the proposed approach, a recently created Hindi-English code-switching corpus has been used. For the contrast purpose, an LID system employing the connectionist temporal classification-based E2E network is also developed. On comparing both the LID systems, the attention based approach is noted to result in better LID accuracy. The effective location of code-switching boundaries within the utterance by the proposed approach has been demonstrated by plotting the attention weights of E2E network.

📄 PDF Abstract BibTeX arXiv:1907.06342

Code (0)

등록된 구현이 없습니다.

Tasks

Language Identification

Similar Papers 제목 키워드 기반

Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models

2021-10-07 · Liang-Hsuan Tseng, Yu-Kuan Fu, Heng-Jui Chang, Hung-Yi Lee

Code-switching (CS) is common in daily conversations where more than one language is used within a sentence. The difficulties of CS speech recognition lie in alternating languages and the lack of transcribed data. Theref…

Language IdentificationSelf-Supervised LearningSentencespeech-recognition+1

Simple yet Effective Code-Switching Language Identification with Multitask Pre-Training and Transfer Learning

2023-05-31 · Shuyue Stella Li, Cihan Xiao, Tianjian Li, Bismarck Odoom

Code-switching, also called code-mixing, is the linguistics phenomenon where in casual settings, multilingual speakers mix words from different languages in one utterance. Due to its spontaneous nature, code-switching is…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationLanguage Identification+3

Indonesian-English Code-Switching Speech Synthesizer Utilizing Multilingual STEN-TTS and Bert LID

2024-12-26 · Ahmad Alfani Handoyo, Chung Tran, Dessi Puji Lestari, Sakriani Sakti

Multilingual text-to-speech systems convert text into speech across multiple languages. In many cases, text sentences may contain segments in different languages, a phenomenon known as code-switching. This is particularl…

Language Identificationtext-to-speechText to Speech

Hindi-English Code-Switching Speech Corpus

2018-09-24 · Sreeram Ganji, Dhawan Kunal, Sinha Rohit

Code-switching refers to the usage of two languages within a sentence or discourse. It is a global phenomenon among multilingual communities and has emerged as an independent area of research. With the increasing demand …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language IdentificationLanguage Modeling+5

Unified model for code-switching speech recognition and language identification based on a concatenated tokenizer

2023-06-14 · Kunal Dhawan, Dima Rekesh, Boris Ginsburg

Code-Switching (CS) multilingual Automatic Speech Recognition (ASR) models can transcribe speech containing two or more alternating languages during a conversation. This paper proposes (1) a new method for creating code-…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language Identificationspeech-recognition+2