Some Grammatical Errors are Frequent, Others are Important
In Grammatical Error Correction, systems are evaluated by the number of errors they correct. However, no one has assessed whether all error types are equally important. We provide and apply a method to quantify the importance of different grammatical error types to humans. We show that some rare errors are considered disturbing while other common ones are not. This affects possible directions to improve both systems and their evaluation.
Code (1)
Tasks
Grammatical Error CorrectionSimilar Papers 제목 키워드 기반
Morpho-Syntactic Study of Errors from Speech Recognition System
The study provides an original standpoint of the speech transcription errors by focusing on the morpho-syntactic features of the erroneous chunks and of the surrounding left and right context. The typology concerns the f…
Named Entity Recognition (NER)POSQuestion Answeringspeech-recognition+1Taking the Correction Difficulty into Account in Grammatical Error Correction Evaluation
This paper presents performance measures for grammatical error correction which take into account the difficulty of error correction. To the best of our knowledge, no conventional measure has such functionality despite t…
Grammatical Error CorrectionExploring Human-judged and Automatically-induced Correction Difficulty for Grammatical Error Correction
While grammatical error correction (GEC) has improved in its correction performance, one of the key challenges in GEC research still remains in evaluation. Specifically, all errors are equally treated in the conventional…
Grammatical Error CorrectionString Editing Based Chinese Grammatical Error Diagnosis
Chinese Grammatical Error Diagnosis (CGED) suffers the problems of numerous types of grammatical errors and insufficiency of training data. In this paper, we propose a string editing based CGED model that requires less t…
TAGDetecting Grammatical Errors in the NTOU CGED System by Identifying Frequent Subsentences
The main goal of Chinese grammatical error diagnosis task is to detect word er-rors in the sentences written by Chinese-learning students. Our previous system would generate error-corrected sentences as candidates and th…
Sentence