홈 › Papers

Cross-lingual Knowledge Transfer and Iterative Pseudo-labeling for Low-Resource Speech Recognition with Transducers

2023-05-23 · Jan Silovsky, Liuhui Deng, Arturo Argueta, Tresi Arvizo, Roger Hsiao, Sasha Kuznietsov, Yiu-Chang Lin, Xiaoqiang Xiao, Yuanyuan Zhang

Voice technology has become ubiquitous recently. However, the accuracy, and hence experience, in different languages varies significantly, which makes the technology not equally inclusive. The availability of data for different languages is one of the key factors affecting accuracy, especially in training of all-neural end-to-end automatic speech recognition systems. Cross-lingual knowledge transfer and iterative pseudo-labeling are two techniques that have been shown to be successful for improving the accuracy of ASR systems, in particular for low-resource languages, like Ukrainian. Our goal is to train an all-neural Transducer-based ASR system to replace a DNN-HMM hybrid system with no manually annotated training data. We show that the Transducer system trained using transcripts produced by the hybrid system achieves 18% reduction in terms of word error rate. However, using a combination of cross-lingual knowledge transfer from related languages and iterative pseudo-labeling, we are able to achieve 35% reduction of the error rate.

📄 PDF Abstract BibTeX arXiv:2305.13652

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech Recognitionspeech-recognition Speech Recognition Transfer Learning

Mutually-paced Knowledge Distillation for Cross-lingual Temporal Knowledge Graph Reasoning

2023-03-27 · Ruijie Wang, Zheng Li, Jingfeng Yang, Tianyu Cao 외

This paper investigates cross-lingual temporal knowledge graph reasoning problem, which aims to facilitate reasoning on Temporal Knowledge Graphs (TKGs) in low-resource languages by transfering knowledge from TKGs in hig…

Knowledge Distillation Knowledge Graphs Transfer Learning

HMS-BERT: Hybrid Multi-Task Self-Training for Multilingual and Multi-Label Cyberbullying Detection

2026-03-13 · Zixin Feng, Xinying Cui, Yifan Sun, Zheng Wei 외 arxiv

Cyberbullying on social media is inherently multilingual and multi-faceted, where abusive behaviors often overlap across multiple categories. Existing methods are commonly limited by monolingual assumptions or single-tas…

Zero-shot Cross-lingual Transfer without Parallel Corpus

2023-10-07 · Yuyang Zhang, Xiaofeng Han, Baojun Wang

Recently, although pre-trained language models have achieved great success on multilingual NLP (Natural Language Processing) tasks, the lack of training data on many tasks in low-resource languages still limits their per…

Cross-Lingual Transfer Multilingual NLP Translation Zero-Shot Cross-Lingual Transfer

UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding

2024-06-24 · Dongyang Li, Taolin Zhang, Jiali Deng, Longtao Huang 외

Cross-lingual representation learning transfers knowledge from resource-rich data to resource-scarce ones to improve the semantic understanding abilities of different languages. However, previous works rely on shallow un…

Data Augmentation Natural Language Understanding Question Answering Representation Learning

Uncertainty-Aware Cross-Lingual Transfer with Pseudo Partial Labels

2022-07-01 · Findings (NAACL) 2022 7 · Shuo Lei, Xuchao Zhang, Jianfeng He, Fanglan Chen 외

Large-scale multilingual pre-trained language models have achieved remarkable performance in zero-shot cross-lingual tasks. A recent study has demonstrated the effectiveness of self-learning-based approach on cross-lingu…

Cross-Lingual Transfer named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)+3