Papers XLM-R

“XLM-R” 태그가 달린 논문 221편 · 필터 해제

Unsupervised Cross-lingual Representation Learning at Scale

2019-11-05 · ACL 2020 6 · Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary 외

This paper shows that pretraining multilingual language models at scale leads to significant performance gains for a wide range of cross-lingual transfer tasks. We train a Transformer-based masked language model on one h…

Cross-Lingual Transfer Language Modeling Language Modelling Multilingual NLP+2