Machine Learning--Driven Language Assessment
We describe a method for rapidly creating language proficiency assessments, and provide experimental evidence that such tests can be valid, reliable, and secure. Our approach is the first to use machine learning and natural language processing to induce proficiency scales based on a given standard, and then use linguistic models to estimate item difficulty directly for computer-adaptive testing. This alleviates the need for expensive pilot testing with human subjects. We used these methods to develop an online proficiency exam called the Duolingo English Test, and demonstrate that its scores align significantly with other high-stakes English assessments. Furthermore, our approach produces test scores that are highly reliable, while generating item banks large enough to satisfy security requirements.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningLanguage AcquisitionSkills AssessmentvalidSimilar Papers 제목 키워드 기반
A Survey on Data-driven Software Vulnerability Assessment and Prioritization
Software Vulnerabilities (SVs) are increasing in complexity and scale, posing great security risks to many software systems. Given the limited resources in practice, SV assessment and prioritization help practitioners de…
CoMAI: A Collaborative Multi-Agent Framework for Robust and Equitable Interview Evaluation
Ensuring robust and fair interview assessment remains a key challenge in AI-driven evaluation. This paper presents CoMAI, a general-purpose multi-agent interview framework designed for diverse assessment scenarios. In co…
Question GenerationHybrid data driven/thermal simulation model for comfort assessment
Machine learning models improve the speed and quality of physical models. However, they require a large amount of data, which is often difficult and costly to acquire. Predicting thermal comfort, for example, requires a …
BenchmarkingA novel Information-Driven Strategy for Optimal Regression Assessment
In Machine Learning (ML), a regression algorithm aims to minimize a loss function based on data. An assessment method in this context seeks to quantify the discrepancy between the optimal response for an input-output sys…
Bridging Chemists and AI: An Expert-Augmented Framework for Interpretable Route Evaluation
Selecting efficient multi-step synthetic routes is a central challenge in organic synthesis, particularly in medicinal and process chemistry, where route choice directly impacts feasibility, cost, and development efficie…