Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study
Neural sequence-to-sequence (seq2seq) approaches have proven to be successful in grammatical error correction (GEC). Based on the seq2seq framework, we propose a novel fluency boost learning and inference mechanism. Fluency boosting learning generates diverse error-corrected sentence pairs during training, enabling the error correction model to learn how to improve a sentence's fluency from more instances, while fluency boosting inference allows the model to correct a sentence incrementally with multiple inference steps. Combining fluency boost learning and inference with convolutional seq2seq models, our approach achieves the state-of-the-art performance: 75.72 (F_{0.5}) on CoNLL-2014 10 annotation dataset and 62.42 (GLEU) on JFLEG test set respectively, becoming the first GEC system that reaches human-level performance (72.58 for CoNLL and 62.37 for JFLEG) on both of the benchmarks.
Code (1)
Tasks
Grammatical Error CorrectionSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation
We combine two of the most popular approaches to automated Grammatical Error Correction (GEC): GEC based on Statistical Machine Translation (SMT) and GEC based on Neural Machine Translation (NMT). The hybrid system achie…
Grammatical Error CorrectionMachine TranslationNMTTranslationIMPARA-GED: Grammatical Error Detection is Boosting Reference-free Grammatical Error Quality Estimator
We propose IMPARA-GED, a novel reference-free automatic grammatical error correction (GEC) evaluation method with grammatical error detection (GED) capabilities. We focus on the quality estimator of IMPARA, an existing a…
Grammatical Error CorrectionGrammatical Error DetectionLanguage ModelingLanguage Modelling+1Overview of NLPTEA-2020 Shared Task for Chinese Grammatical Error Diagnosis
This paper presents the NLPTEA 2020 shared task for Chinese Grammatical Error Diagnosis (CGED) which seeks to identify grammatical error types, their range of occurrence and recommended corrections within sentences writt…
PositionOverview of NLPTEA-2018 Share Task Chinese Grammatical Error Diagnosis
This paper presents the NLPTEA 2018 shared task for Chinese Grammatical Error Diagnosis (CGED) which seeks to identify grammatical error types, their range of occurrence and recommended corrections within sentences writt…
Grammatical Error CorrectionPositionThere's No Comparison: Reference-less Evaluation Metrics in Grammatical Error Correction
Current methods for automatically evaluating grammatical error correction (GEC) systems rely on gold-standard references. However, these methods suffer from penalizing grammatical edits that are correct but not in the go…
BenchmarkingGrammatical Error CorrectionSentence