paper-with-me

홈 › Papers

Label Aware Speech Representation Learning For Language Identification

2023-06-07 · Shikhar Vashishth, Shikhar Bharadwaj, Sriram Ganapathy, Ankur Bapna, Min Ma, Wei Han, Vera Axelrod, Partha Talukdar

Speech representation learning approaches for non-semantic tasks such as language recognition have either explored supervised embedding extraction methods using a classifier model or self-supervised representation learning approaches using raw data. In this paper, we propose a novel framework of combining self-supervised representation learning with the language label information for the pre-training task. This framework, termed as Label Aware Speech Representation (LASR) learning, uses a triplet based objective function to incorporate language labels along with the self-supervised loss function. The speech representations are further fine-tuned for the downstream task. The language recognition experiments are performed on two public datasets - FLEURS and Dhwani. In these experiments, we illustrate that the proposed LASR framework improves over the state-of-the-art systems on language identification. We also report an analysis of the robustness of LASR approach to noisy/missing labels as well as its application to multi-lingual speech recognition tasks.

📄 PDF Abstract BibTeX arXiv:2306.04374

Code (0)

등록된 구현이 없습니다.

Tasks

Language IdentificationMissing LabelsRepresentation Learningspeech-recognitionSpeech RecognitionSpeech Representation LearningTriplet

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

MASR: Multi-label Aware Speech Representation

2023-07-20 · Anjali Raj, Shikhar Bharadwaj, Sriram Ganapathy, Min Ma 외

In the recent years, speech representation learning is constructed primarily as a self-supervised learning (SSL) task, using the raw audio signal alone, while ignoring the side-information that is often available for a g…

Emotion RecognitionLanguage IdentificationRepresentation LearningSelf-Supervised Learning+3

Joint unsupervised and supervised learning for context-aware language identification

2023-03-29 · Jinseok Park, Hyung Yong Kim, Jihwan Park, Byeong-Yeol Kim 외

Language identification (LID) recognizes the language of a spoken utterance automatically. According to recent studies, LID models trained with an automatic speech recognition (ASR) task perform better than those trained…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language IdentificationLanguage Modeling+4

Improved Language Identification Through Cross-Lingual Self-Supervised Learning

2021-07-08 · Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang, Kritika Singh 외

Language identification greatly impacts the success of downstream tasks such as automatic speech recognition. Recently, self-supervised speech representations learned by wav2vec 2.0 have been shown to be very effective f…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language IdentificationSelf-Supervised Learning+2

Code-Switching Spoken Language Identification as Multi-Label Set Prediction

2026-10-01 · Shunsuke Mitsumori, Matthew Wiesner, Shigeo Morishima, Shinji Watanabe arxiv

Code-switched (CS) speech leaks through the monolingual language identification (LID) filters used to curate massive speech corpora, calling for CS-aware LID (CS-LID). We formulate utterance-level CS-LID as multi-label l…

Spoken language identification

Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models

2021-10-07 · Liang-Hsuan Tseng, Yu-Kuan Fu, Heng-Jui Chang, Hung-Yi Lee

Code-switching (CS) is common in daily conversations where more than one language is used within a sentence. The difficulties of CS speech recognition lie in alternating languages and the lack of transcribed data. Theref…

Language IdentificationSelf-Supervised LearningSentencespeech-recognition+1