Curriculum Design for Code-switching: Experiments with Language Identification and Language Modeling with Deep Neural Networks
Code (0)
등록된 구현이 없습니다.
Tasks
Language IdentificationLanguage ModelingLanguage ModellingSimilar Papers 제목 키워드 기반
Code-Switching Curriculum Learning for Multilingual Transfer in LLMs
Large language models (LLMs) now exhibit near human-level performance in various tasks, but their performance drops drastically after a handful of high-resource languages due to the imbalance in pre-training data. Inspir…
Cross-Lingual TransferLanguage AcquisitionSafety AlignmentSentenceEfficient Multilingual Reasoning Transfer via Progressive Code-Switching
Large reasoning models (LRMs) have achieved strong reasoning capabilities in English, yet their performance degrades significantly when required to reason in other languages. A natural solution is to transfer the model's…
Reinforcement LearningCurriculum Recommendations Using Transformer Base Model with InfoNCE Loss And Language Switching Method
The Curriculum Recommendations paradigm is dedicated to fostering learning equality within the ever-evolving realms of educational technology and curriculum development. In acknowledging the inherent obstacles posed by e…
Computational EfficiencySentenceTranslationLow-Resource Machine Translation Training Curriculum Fit for Low-Resource Languages
We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, refle…
Cross-Lingual Bitext MiningLanguage ModellingLow-Resource Neural Machine TranslationMachine Translation+2Zero Resource Code-switched Speech Benchmark Using Speech Utterance Pairs For Multiple Spoken Languages
We introduce a new zero resource code-switched speech benchmark designed to directly assess the code-switching capabilities of self-supervised speech encoders. We showcase a baseline system of language modeling on discre…
Language ModelingLanguage Modelling