paper-with-me

홈 › Papers

Item Development and Scoring for Japanese Oral Proficiency Testing

2012-05-01 · LREC 2012 5 · Hitokazu Matsushita, Deryle Lonsdale

This study introduces and evaluates a computerized approach to measuring Japanese L2 oral proficiency. We present a testing and scoring method that uses a type of structured speech called elicited imitation (EI) to evaluate accuracy of speech productions. Several types of language resources and toolkits are required to develop, administer, and score responses to this test. First, we present a corpus-based test item creation method to produce EI items with targeted linguistic features in a principled and efficient manner. Second, we sketch how we are able to bootstrap a small learner speech corpus to generate a significantly large corpus of training data for language model construction. Lastly, we show how newly created test items effectively classify learners according to their L2 speaking capability and illustrate how our scoring method computes a metric for language proficiency that correlates well with more traditional human scoring methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingSpeech Recognition

Similar Papers 제목 키워드 기반

Student achievement and French sentence repetition test scores

2014-05-01 · LREC 2014 5 · Deryle Lonsdale, Benjamin Millard

Sentence repetition (SR) tests are one way of probing a language learner{'}s oral proficiency. Test-takers listen to a set of carefully engineered sentences of varying complexity one-by-one, and then try to repeat them b…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Sentencespeech-recognition+1

Variational Temporal IRT: Fast, Accurate, and Explainable Inference of Dynamic Learner Proficiency

2023-11-14 · Yunsung Kim, Sreechan Sankaranarayanan, Chris Piech, Candace Thille

Dynamic Item Response Models extend the standard Item Response Theory (IRT) to capture temporal dynamics in learner ability. While these models have the potential to allow instructional systems to actively monitor the ev…

Word-Embedding based Content Features for Automated Oral Proficiency Scoring

2018-08-01 · WS 2018 8 · Su-Youn Yoon, Anastassia Loukina, Chong MIn Lee, Matthew Mulholland 외
Rhythmspeech-recognitionSpeech RecognitionWord Embeddings

Content Modeling for Automated Oral Proficiency Scoring System

2019-08-01 · WS 2019 8 · Su-Youn Yoon, Chong MIn Lee

We developed an automated oral proficiency scoring system for non-native English speakers{'} spontaneous speech. Automated systems that score holistic proficiency are expected to assess a wide range of performance catego…

AutoIRT: Calibrating Item Response Theory Models with Automated Machine Learning

2024-09-13 · James Sharpnack, Phoebe Mulcaire, Klinton Bicknell, Geoff LaFlair 외

Item response theory (IRT) is a class of interpretable factor models that are widely used in computerized adaptive tests (CATs), such as language proficiency tests. Traditionally, these are fit using parametric mixed eff…

AutoML