Unsupervised Grammatical Error Correction Rivaling Supervised Methods
State-of-the-art grammatical error correction (GEC) systems rely on parallel training data (ungrammatical sentences and their manually corrected counterparts), which are expensive to construct. In this paper, we employ the Break-It-Fix-It (BIFI) method to build an unsupervised GEC system. The BIFI framework generates parallel data from unlabeled text using a fixer to transform ungrammatical sentences into grammatical ones, and a critic to predict sentence grammaticality. We present an unsupervised approach to build the fixer and the critic, and an algorithm that allows them to iteratively improve each other. We evaluate our unsupervised GEC system on English and Chinese GEC. Empirical results show that our GEC system outperforms previous unsupervised GEC systems, and achieves performance comparable to supervised GEC systems without ensemble. Furthermore, when combined with labeled training data, our system achieves new state-of-the-art results on the CoNLL-2014 and NLPCC-2018 test sets.
Code (1)
Tasks
Grammatical Error CorrectionSentenceSimilar Papers 제목 키워드 기반
(Almost) Unsupervised Grammatical Error Correction using Synthetic Comparable Corpus
We introduce unsupervised techniques based on phrase-based statistical machine translation for grammatical error correction (GEC) trained on a pseudo learner corpus created by Google Translation. We verified our GEC syst…
Grammatical Error CorrectionMachine TranslationTranslationTowards Unsupervised Grammatical Error Correction using Statistical Machine Translation with Synthetic Comparable Corpus
We introduce unsupervised techniques based on phrase-based statistical machine translation for grammatical error correction (GEC) trained on a pseudo learner corpus created by Google Translation. We verified our GEC syst…
Grammatical Error CorrectionMachine TranslationTranslationMinimally-Augmented Grammatical Error Correction
There has been an increased interest in low-resource approaches to automatic grammatical error correction. We introduce Minimally-Augmented Grammatical Error Correction (MAGEC) that does not require any error-labelled da…
Grammatical Error CorrectionLM-Critic: Language Models for Unsupervised Grammatical Error Correction
Training a model for grammatical error correction (GEC) requires a set of labeled ungrammatical / grammatical sentence pairs, but manually annotating such pairs can be expensive. Recently, the Break-It-Fix-It (BIFI) fram…
Grammatical Error CorrectionLanguage ModelingLanguage ModellingSentence+1A BERT-based Unsupervised Grammatical Error Correction Framework
Grammatical error correction (GEC) is a challenging task of natural language processing techniques. While more attempts are being made in this approach for universal languages like English or Chinese, relatively little w…
Grammatical Error CorrectionLanguage ModelingLanguage ModellingMulti-class Classification+1