Weakly Supervised Grammatical Error Correction using Iterative Decoding
We describe an approach to Grammatical Error Correction (GEC) that is effective at making use of models trained on large amounts of weakly supervised bitext. We train the Transformer sequence-to-sequence model on 4B tokens of Wikipedia revisions and employ an iterative decoding strategy that is tailored to the loosely-supervised nature of the Wikipedia training corpus. Finetuning on the Lang-8 corpus and ensembling yields an F0.5 of 58.3 on the CoNLL'14 benchmark and a GLEU of 62.4 on JFLEG. The combination of weakly supervised training and iterative decoding obtains an F0.5 of 48.2 on CoNLL'14 even without using any labeled GEC data.
Code (0)
등록된 구현이 없습니다.
Tasks
Grammatical Error CorrectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Grammatical Error Correction Rivaling Supervised Methods
State-of-the-art grammatical error correction (GEC) systems rely on parallel training data (ungrammatical sentences and their manually corrected counterparts), which are expensive to construct. In this paper, we employ t…
Grammatical Error CorrectionSentenceGrammatical Error Correction as GAN-like Sequence Labeling
In Grammatical Error Correction (GEC), sequence labeling models enjoy fast inference compared to sequence-to-sequence models; however, inference in sequence labeling GEC models is an iterative process, as sentences are p…
Grammatical Error CorrectionListen, Correct, and Feed Back: Spoken Pedagogical Feedback Generation
Grammatical error correction (GEC) and explanation (GEE) have made rapid progress, but real teaching scenarios also require \emph{learner-friendly pedagogical feedback} that is actionable, level-appropriate, and encourag…
Grammatical Error CorrectionMinimally-Augmented Grammatical Error Correction
There has been an increased interest in low-resource approaches to automatic grammatical error correction. We introduce Minimally-Augmented Grammatical Error Correction (MAGEC) that does not require any error-labelled da…
Grammatical Error Correction(Almost) Unsupervised Grammatical Error Correction using Synthetic Comparable Corpus
We introduce unsupervised techniques based on phrase-based statistical machine translation for grammatical error correction (GEC) trained on a pseudo learner corpus created by Google Translation. We verified our GEC syst…
Grammatical Error CorrectionMachine TranslationTranslation