Are BERTs Sensitive to Native Interference in L2 Production?
With the essays part from The International Corpus Network of Asian Learners of English (ICNALE) and the TOEFL11 corpus, we fine-tuned neural language models based on BERT to predict English learners’ native languages. Results showed neural models can learn to represent and detect such native language impacts, but multilingually trained models have no advantage in doing so.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
fairBERTs: Erasing Sensitive Information Through Semantic and Fairness-aware Perturbations
Pre-trained language models (PLMs) have revolutionized both the natural language processing research and applications. However, stereotypical biases (e.g., gender and racial discrimination) encoded in PLMs have raised ne…
FairnessGenerative Adversarial NetworkA Fine-Grained Analysis of BERTScore
BERTScore, a recently proposed automatic metric for machine translation quality, uses BERT, a large pre-trained language model to evaluate candidate translations with respect to a gold translation. Taking advantage of BE…
Language ModelingLanguage ModellingMachine TranslationSemantic Similarity+3Surprisal Minimisation over Goal-directed Alternatives Predicts Production Choice in Dialogue
We model utterance production as probabilistic cost-sensitive choice over contextual alternatives, using information-theoretic notions of cost. We distinguish between goal-directed alternatives that realise a fixed commu…
An information-theoretic account of semantic interference in word production
I present a computational-level model of semantic interference effects in word production. Word production is cast as a rate-distortion problem where an agent selects words to minimize a measure of cost while also minimi…
HyGen: Efficient LLM Serving via Elastic Online-Offline Request Co-location
Large language models (LLMs) have facilitated a wide range of applications with distinct service-level objectives (SLOs), from latency-sensitive online tasks like interactive chatbots to throughput-oriented offline workl…
Document SummarizationManagementScheduling