Neural Quality Estimation of Grammatical Error Correction
Grammatical error correction (GEC) systems deployed in language learning environments are expected to accurately correct errors in learners{'} writing. However, in practice, they often produce spurious corrections and fail to correct many errors, thereby misleading learners. This necessitates the estimation of the quality of output sentences produced by GEC systems so that instructors can selectively intervene and re-correct the sentences which are poorly corrected by the system and ensure that learners get accurate feedback. We propose the first neural approach to automatic quality estimation of GEC output sentences that does not employ any hand-crafted features. Our system is trained in a supervised manner on learner sentences and corresponding GEC system outputs with quality score labels computed using human-annotated references. Our neural quality estimation models for GEC show significant improvements over a strong feature-based baseline. We also show that a state-of-the-art GEC system can be improved when quality scores are used as features for re-ranking the N-best candidates.
Code (1)
Tasks
Grammatical Error CorrectionMachine TranslationRe-RankingSimilar Papers 제목 키워드 기반
Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correction
Grammatical Error Correction (GEC) aims to correct writing errors and help language learners improve their writing skills. However, existing GEC models tend to produce spurious corrections or fail to detect lots of error…
Grammatical Error CorrectionGrammatical Error DetectionRerankingConstruction of a Quality Estimation Dataset for Automatic Evaluation of Japanese Grammatical Error Correction
In grammatical error correction (GEC), automatic evaluation is an important factor for research and development of GEC systems. Previous studies on automatic evaluation have demonstrated that quality estimation models bu…
Grammatical Error CorrectionSystem Combination via Quality Estimation for Grammatical Error Correction
Quality estimation models have been developed to assess the corrections made by grammatical error correction (GEC) models when the reference or gold-standard corrections are not available. An ideal quality estimator can …
Grammatical Error CorrectionSentenceProficiency Matters Quality Estimation in Grammatical Error Correction
This study investigates how supervised quality estimation (QE) models of grammatical error correction (GEC) are affected by the learners' proficiency with the data. QE models for GEC evaluations in prior work have obtain…
Grammatical Error CorrectionProQE: Proficiency-wise Quality Estimation dataset for Grammatical Error Correction
This study investigates how supervised quality estimation (QE) models of grammatical error correction (GEC) are affected by the learners’ proficiency with the data. QE models for GEC evaluations in prior work have obtain…
Grammatical Error Correction