Evaluating Cross-Lingual Transfer Learning Approaches in Multilingual Conversational Agent Models
With the recent explosion in popularity of voice assistant devices, there is a growing interest in making them available to user populations in additional countries and languages. However, to provide the highest accuracy and best performance for specific user populations, most existing voice assistant models are developed individually for each region or language, which requires linear investment of effort. In this paper, we propose a general multilingual model framework for Natural Language Understanding (NLU) models, which can help bootstrap new language models faster and reduce the amount of effort required to develop each language separately. We explore how different deep learning architectures affect multilingual NLU model performance. Our experimental results show that these multilingual models can reach same or better performance compared to monolingual models across language-specific test data while require less effort in creating features and model maintenance.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual TransferNatural Language UnderstandingTransfer LearningSimilar Papers 제목 키워드 기반
Bilingual alignment transfers to multilingual alignment for unsupervised parallel text mining
This work presents methods for learning cross-lingual sentence representations using paired or unpaired bilingual texts. We hypothesize that the cross-lingual alignment strategy is transferable, and therefore a model tra…
Language ModelingLanguage ModellingRetrievalSentence+1XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization
Much recent progress in applications of machine learning models to NLP has been driven by benchmarks that evaluate models across a wide variety of tasks. However, these broad-coverage benchmarks have been mostly limited …
Cross-Lingual TransferRetrievalSentenceSentence RetrievalXTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation
Much recent progress in applications of machine learning models to NLP has been driven by benchmarks that evaluate models across a wide variety of tasks. However, these broad-coverage benchmarks have been mostly limited …
Cross-Lingual TransferRetrievalSentenceSentence Retrieval+1Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation
The recently proposed massively multilingual neural machine translation (NMT) system has been shown to be capable of translating over 100 languages to and from English within a single model. Its improved translation perf…
Cross-Lingual TransferMachine TranslationNMTTransfer Learning+1First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT
Multilingual pretrained language models have demonstrated remarkable zero-shot cross-lingual transfer capabilities. Such transfer emerges by fine-tuning on a task of interest in one language and evaluating on a distinct …
Cross-Lingual TransferLanguage ModelingLanguage ModellingZero-Shot Cross-Lingual Transfer