Student achievement and French sentence repetition test scores
Sentence repetition (SR) tests are one way of probing a language learner{'}s oral proficiency. Test-takers listen to a set of carefully engineered sentences of varying complexity one-by-one, and then try to repeat them back as exactly as possible. In this paper we explore how well an SR test that we have developed for French corresponds with the test-taker{'}s achievement levels, represented by proficiency interview scores and by college class enrollment. We describe how we developed our SR test items using various language resources, and present pertinent facts about the test administration. The responses were scored by humans and also by a specially designed automatic speech recognition (ASR) engine; we sketch both scoring approaches. Results are evaluated in several ways: correlations between human and ASR scores, item response analysis to quantify the relative difficulty of the items, and criterion-referenced analysis setting thresholds of consistency across proficiency levels. We discuss several observations and conclusions prompted by the analyses, and suggestions for future work.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Sentencespeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Measuring Conversational Uptake: A Case Study on Student-Teacher Interactions
In conversation, uptake happens when a speaker builds on the contribution of their interlocutor by, for example, acknowledging, repeating or reformulating what they have said. In education, teachers' uptake of student co…
MathQuestion AnsweringAutomatically measuring speech fluency in people with aphasia: first achievements using read-speech data
Background: Speech and language pathologists (SLPs) often relyon judgements of speech fluency for diagnosing or monitoringpatients with aphasia. However, such subjective methods havebeen criticised for their lack of reli…
DiagnosticLanguage AcquisitionSentenceAutomatic detection of other-repetition occurrences: application to French conversational Speech
This paper investigates the discursive phenomenon called other-repetitions (OR), particularly in the context of spontaneous French dialogues. It focuses on their automatic detection and characterization. A method is prop…
TransliterationMachine Learning Classifiers Do Not Improve the Prediction of Academic Risk: Evidence from Australia
Machine learning methods tend to outperform traditional statistical models at prediction. In the prediction of academic achievement, ML models have not shown substantial improvement over logistic regression. So far, thes…
BIG-bench Machine LearningregressionWhat is essential is visible to the eye: Saliency in primary school ranking and its effect on academic achievements
We propose a new strategy to identify the impact of class rank, exploiting a "visible" primary school rank from teachers' exam grades, and an "invisible" rank from unreported standardized test scores. Leveraging a unique…