Semi-supervised Development of ASR Systems for Multilingual Code-switched Speech in Under-resourced Languages
This paper reports on the semi-supervised development of acoustic and language models for under-resourced, code-switched speech in five South African languages. Two approaches are considered. The first constructs four separate bilingual automatic speech recognisers (ASRs) corresponding to four different language pairs between which speakers switch frequently. The second uses a single, unified, five-lingual ASR system that represents all the languages (English, isiZulu, isiXhosa, Setswana and Sesotho). We evaluate the effectiveness of these two approaches when used to add additional data to our extremely sparse training sets. Results indicate that batch-wise semi-supervised training yields better results than a non-batch-wise approach. Furthermore, while the separate bilingual systems achieved better recognition performance than the unified system, they benefited more from pseudo-labels generated by the five-lingual system than from those generated by the bilingual systems.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Semi Supervised Preposition-Sense Disambiguation using Multilingual Data
Prepositions are very common and very ambiguous, and understanding their sense is critical for understanding the meaning of the sentence. Supervised corpora for the preposition-sense disambiguation task are small, sugges…
General ClassificationSentenceTranslationPseudo-Labeling for Massively Multilingual Speech Recognition
Semi-supervised learning through pseudo-labeling has become a staple of state-of-the-art monolingual speech recognition systems. In this work, we extend pseudo-labeling to massively multilingual speech recognition with 6…
speech-recognitionSpeech RecognitionSemi-supervised acoustic and language model training for English-isiZulu code-switched speech recognition
We present an analysis of semi-supervised acoustic and language model training for English-isiZulu code-switched ASR using soap opera speech. Approximately 11 hours of untranscribed multilingual speech was transcribed au…
Language ModelingLanguage Modellingspeech-recognitionSpeech RecognitionSemi-supervised acoustic and language model training for English-isiZulu code-switched speech recognition
We present an analysis of semi-supervised acoustic and language model training for English-isiZulu code-switched (CS) ASR using soap opera speech. Approximately 11 hours of untranscribed multilingual speech was transcrib…
Language ModelingLanguage Modellingspeech-recognitionSpeech RecognitionNLPDove at SemEval-2020 Task 12: Improving Offensive Language Detection with Cross-lingual Transfer
This paper describes our approach to the task of identifying offensive languages in a multilingual setting. We investigate two data augmentation strategies: using additional semi-supervised labels with different threshol…
Cross-Lingual TransferData AugmentationLanguage IdentificationTranslation