paper-with-me

홈 › Papers

Spoken Grammar Assessment Using LLM

2024-10-02 · Sunil Kumar Kopparapu, Chitralekha Bhat, Ashish Panda

Spoken language assessment (SLA) systems restrict themselves to evaluating the pronunciation and oral fluency of a speaker by analysing the read and spontaneous spoken utterances respectively. The assessment of language grammar or vocabulary is relegated to written language assessment (WLA) systems. Most WLA systems present a set of sentences from a curated finite-size database of sentences thereby making it possible to anticipate the test questions and train oneself. In this paper, we propose a novel end-to-end SLA system to assess language grammar from spoken utterances thus making WLA systems redundant; additionally, we make the assessment largely unteachable by employing a large language model (LLM) to bring in variations in the test. We further demonstrate that a hybrid automatic speech recognition (ASR) with a custom-built language model outperforms the state-of-the-art ASR engine for spoken grammar assessment.

📄 PDF Abstract BibTeX arXiv:2410.01579

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage ModellingLarge Language Modelspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

An Initial Investigation of Non-Native Spoken Question-Answering

2021-07-09 · Vatsal Raina, Mark J. F. Gales

Text-based machine comprehension (MC) systems have a wide-range of applications, and standard corpora exist for developing and evaluating approaches. There has been far less research on spoken question answering (SQA) sy…

Question AnsweringReading ComprehensionTransfer Learning

Advancing Automated Speaking Assessment Leveraging Multifaceted Relevance and Grammar Information

2025-06-19 · Hao-Chien Lu, Jhen-Ke Lin, Hong-Yun Lin, Chung-Chun Wang 외

Current automated speaking assessment (ASA) systems for use in multi-aspect evaluations often fail to make full use of content relevance, overlooking image or exemplar cues, and employ superficial grammar analysis that l…

Zero-Shot Grammar Competency Estimation Using Large Language Model Generated Pseudo Labels

2025-11-17 · Sourya Dipta Das, Shubham Kumar, Kuldeep Yadav arxiv

Grammar competency estimation is essential for assessing linguistic proficiency in both written and spoken language; however, the spoken modality presents additional challenges due to its spontaneous, unstructured, and d…

Towards End-to-End Spoken Grammatical Error Correction

2023-11-09 · Stefano Bannò, Rao Ma, Mengjie Qian, Kate M. Knill 외

Grammatical feedback is crucial for L2 learners, teachers, and testers. Spoken grammatical error correction (GEC) aims to supply feedback to L2 learners on their use of grammar when speaking. This process usually relies …

Grammatical Error Correctionspeech-recognitionSpeech Recognition

Data Augmentation for Spoken Grammatical Error Correction

2025-07-25 · Penny Karanasou, Mengjie Qian, Stefano Bannò, Mark J. F. Gales 외 arxiv

While there exist strong benchmark datasets for grammatical error correction (GEC), high-quality annotated spoken datasets for Spoken GEC (SGEC) are still under-resourced. In this paper, we propose a fully automated meth…

Grammatical Error CorrectionData Augmentation