paper-with-me

홈 › Papers

Improving Uyghur ASR systems with decoders using morpheme-based language models

2020-03-03 · Zicheng Qiu, Wei Jiang, Turghunjan Mamut

Uyghur is a minority language, and its resources for Automatic Speech Recognition (ASR) research are always insufficient. THUYG-20 is currently the only open-sourced dataset of Uyghur speeches. State-of-the-art results of its clean and noiseless speech test task haven't been updated since the first release, which shows a big gap in the development of ASR between mainstream languages and Uyghur. In this paper, we try to bridge the gap by ultimately optimizing the ASR systems, and by developing a morpheme-based decoder, MLDG-Decoder (Morpheme Lattice Dynamically Generating Decoder for Uyghur DNN-HMM systems), which has long been missing. We have open-sourced the decoder. The MLDG-Decoder employs an algorithm, named as "on-the-fly composition with FEBABOS", to allow the back-off states and transitions to play the role of a relay station in on-the-fly composition. The algorithm empowers the dynamically generated graph to constrain the morpheme sequences in the lattices as effectively as the static and fully composed graph does when a 4-Gram morpheme-based Language Model (LM) is used. We have trained deeper and wider neural network acoustic models, and experimented with three kinds of decoding schemes. The experimental results show that the decoding based on the static and fully composed graph reduces state-of-the-art Word Error Rate (WER) on the clean and noiseless speech test task in THUYG-20 to 14.24%. The MLDG-Decoder reduces the WER to 14.54% while keeping the memory consumption reasonable. Based on the open-sourced MLDG-Decoder, readers can easily reproduce the experimental results in this paper.

📄 PDF Abstract BibTeX arXiv:2003.01509

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderLanguage Modellingspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Building Language Models for Morphological Rich Low-Resource Languages using Data from Related Donor Languages: the Case of Uyghur

2020-05-01 · LREC 2020 5 · Ayimunishagu Abulimiti, Tanja Schultz

Huge amounts of data are needed to build reliable statistical language models. Automatic speech processing tasks in low-resource languages typically suffer from lower performances due to weak or unreliable language model…

Language ModelingLanguage Modelling

Adapting Word Embeddings to New Languages with Morphological and Phonological Subword Representations

2018-08-28 · EMNLP 2018 10 · Aditi Chaudhary, Chunting Zhou, Lori Levin, Graham Neubig 외

Much work in Natural Language Processing (NLP) has been for resource-rich languages, making generalization to new, less-resourced languages challenging. We present two approaches for improving generalization to low-resou…

AvgMachine Translationnamed-entity-recognitionNamed Entity Recognition+5

Automatic Speech Recognition for Uyghur through Multilingual Acoustic Modeling

2020-05-01 · LREC 2020 5 · Ayimunishagu Abulimiti, Tanja Schultz

Low-resource languages suffer from lower performance of Automatic Speech Recognition (ASR) system due to the lack of data. As a common approach, multilingual training has been applied to achieve more context coverage and…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Noisy Uyghur Text Normalization

2017-09-01 · WS 2017 9 · Osman Tursun, Ruket Cakici

Uyghur is the second largest and most actively used social media language in China. However, a non-negligible part of Uyghur text appearing in social media is unsystematically written with the Latin alphabet, and it cont…

DecoderText Normalization

Toward Better Loanword Identification in Uyghur Using Cross-lingual Word Embeddings

2018-08-01 · COLING 2018 8 · Chenggang Mi, Yating Yang, Lei Wang, Xi Zhou 외

To enrich vocabulary of low resource settings, we proposed a novel method which identify loanwords in monolingual corpora. More specifically, we first use cross-lingual word embeddings as the core feature to generate sem…

Cross-Lingual Word EmbeddingsLanguage ModelingLanguage ModellingMachine Translation+2