paper-with-me

홈 › Papers

A Study of Multilingual End-to-End Speech Recognition for Kazakh, Russian, and English

2021-08-03 · Saida Mussakhojayeva, Yerbolat Khassanov, Huseyin Atakan Varol

We study training a single end-to-end (E2E) automatic speech recognition (ASR) model for three languages used in Kazakhstan: Kazakh, Russian, and English. We first describe the development of multilingual E2E ASR based on Transformer networks and then perform an extensive assessment on the aforementioned languages. We also compare two variants of output grapheme set construction: combined and independent. Furthermore, we evaluate the impact of LMs and data augmentation techniques on the recognition performance of the multilingual E2E ASR. In addition, we present several datasets for training and evaluation purposes. Experiment results show that the multilingual models achieve comparable performances to the monolingual baselines with a similar number of parameters. Our best monolingual and multilingual models achieved 20.9% and 20.5% average word error rates on the combined test set, respectively. To ensure the reproducibility of our experiments and results, we share our training recipes, datasets, and pre-trained models.

📄 PDF Abstract BibTeX arXiv:2108.01280

Code (1)

IS2AI/MultilingualASR 공식 구현

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data Augmentationspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

100,000+ Movie Reviews from Kazakhstan: Russian, Kazakh, and Code-Switched Texts

2026-05-09 · Rustem Yeshpanov arxiv

We present a new publicly available corpus of 100,502 movie reviews from Kazakhstan collected from kino.kz, spanning 2001-2025 and covering 4,943 unique titles. The dataset is multilingual, consisting mainly of Russian r…

Qorgau: Evaluating LLM Safety in Kazakh-Russian Bilingual Contexts

2025-02-19 · Maiya Goloburda, Nurkhan Laiyk, Diana Turmakhan, Yuxia Wang 외

Large language models (LLMs) are known to have the potential to generate harmful content, posing risks to users. While significant progress has been made in developing taxonomies for LLM risks and safety evaluation promp…

HKR For Handwritten Kazakh & Russian Database

2020-07-07 · Daniyar Nurseitov, Kairat Bostanbekov, Daniyar Kurmankhojayev, Anel Alimova 외

In this paper, we present a new Russian and Kazakh database (with about 95% of Russian and 5% of Kazakh words/sentences respectively) for offline handwriting recognition. A few pre-processing and segmentation procedures …

Handwriting Recognition

Classification of Handwritten Names of Cities and Handwritten Text Recognition using Various Deep Learning Models

2021-02-09 · Daniyar Nurseitov, Kairat Bostanbekov, Maksat Kanatov, Anel Alimova 외

This article discusses the problem of handwriting recognition in Kazakh and Russian languages. This area is poorly studied since in the literature there are almost no works in this direction. We have tried to describe va…

Handwriting RecognitionHandwritten Text Recognition

Towards Large Vocabulary Kazakh-Russian Sign Language Dataset: KRSL-OnlineSchool

2022-06-01 · SignLang (LREC) 2022 6 · Medet Mukushev, Aigerim Kydyrbekova, Vadim Kimmelman, Anara Sandygulova

This paper presents a new dataset for Kazakh-Russian Sign Language (KRSL) created for the purposes of Sign Language Processing. In 2020, Kazakhstan’s schools were quickly switched to online mode due to the COVID-19 pande…

Sign Language TranslationSpeech-to-Text