Second Language Acquisition of Neural Language Models
With the success of neural language models (LMs), their language acquisition has gained much attention. This work sheds light on the second language (L2) acquisition of LMs, while previous work has typically explored their first language (L1) acquisition. Specifically, we trained bilingual LMs with a scenario similar to human L2 acquisition and analyzed their cross-lingual transfer from linguistic perspectives. Our exploratory experiments demonstrated that the L1 pretraining accelerated their linguistic generalization in L2, and language transfer configurations (e.g., the L1 choice, and presence of parallel texts) substantially affected their generalizations. These clarify their (non-)human-like L2 acquisition in particular aspects.
Code (1)
Tasks
Cross-Lingual TransferLanguage AcquisitionSimilar Papers 제목 키워드 기반
SLABERT Talk Pretty One Day: Modeling Second Language Acquisition with BERT
Second language acquisition (SLA) research has extensively studied cross-linguistic transfer, the influence of linguistic structure of a speaker's native language [L1] on the successful acquisition of a foreign language …
Cross-Lingual TransferLanguage AcquisitionTransfer LearningFeature Engineering for Second Language Acquisition Modeling
Knowledge tracing serves as a keystone in delivering personalized education. However, few works attempted to model students{'} knowledge state in the setting of Second Language Acquisition. The Duolingo Shared Task on Se…
Feature EngineeringKnowledge TracingLanguage AcquisitionSecond Language Acquisition Modeling
We present the task of \textit{second language acquisition (SLA) modeling}. Given a history of errors made by learners of a second language, the task is to predict errors that they are likely to make at arbitrary points …
Knowledge TracingLanguage Acquisition