paper-with-me

홈 › Papers

Unsupervised Grammatical Error Correction Rivaling Supervised Methods

2023-12-06 · EMNLP 2023 2023 12 · Hannan Cao, Liping Yuan, Yuchen Zhang, Hwee Tou Ng

State-of-the-art grammatical error correction (GEC) systems rely on parallel training data (ungrammatical sentences and their manually corrected counterparts), which are expensive to construct. In this paper, we employ the Break-It-Fix-It (BIFI) method to build an unsupervised GEC system. The BIFI framework generates parallel data from unlabeled text using a fixer to transform ungrammatical sentences into grammatical ones, and a critic to predict sentence grammaticality. We present an unsupervised approach to build the fixer and the critic, and an algorithm that allows them to iteratively improve each other. We evaluate our unsupervised GEC system on English and Chinese GEC. Empirical results show that our GEC system outperforms previous unsupervised GEC systems, and achieves performance comparable to supervised GEC systems without ensemble. Furthermore, when combined with labeled training data, our system achieves new state-of-the-art results on the CoNLL-2014 and NLPCC-2018 test sets.

📄 PDF Abstract BibTeX

Code (1)

nusnlp/ugec 공식 구현 pytorch

Tasks

Grammatical Error CorrectionSentence

Similar Papers 제목 키워드 기반

(Almost) Unsupervised Grammatical Error Correction using Synthetic Comparable Corpus

2019-08-01 · WS 2019 8 · Satoru Katsumata, Mamoru Komachi

We introduce unsupervised techniques based on phrase-based statistical machine translation for grammatical error correction (GEC) trained on a pseudo learner corpus created by Google Translation. We verified our GEC syst…

Grammatical Error CorrectionMachine TranslationTranslation

Towards Unsupervised Grammatical Error Correction using Statistical Machine Translation with Synthetic Comparable Corpus

2019-07-23 · Satoru Katsumata, Mamoru Komachi

We introduce unsupervised techniques based on phrase-based statistical machine translation for grammatical error correction (GEC) trained on a pseudo learner corpus created by Google Translation. We verified our GEC syst…

Grammatical Error CorrectionMachine TranslationTranslation

Minimally-Augmented Grammatical Error Correction

2019-11-01 · WS 2019 11 · Roman Grundkiewicz, Marcin Junczys-Dowmunt

There has been an increased interest in low-resource approaches to automatic grammatical error correction. We introduce Minimally-Augmented Grammatical Error Correction (MAGEC) that does not require any error-labelled da…

Grammatical Error Correction

LM-Critic: Language Models for Unsupervised Grammatical Error Correction

2021-09-14 · EMNLP 2021 11 · Michihiro Yasunaga, Jure Leskovec, Percy Liang

Training a model for grammatical error correction (GEC) requires a set of labeled ungrammatical / grammatical sentence pairs, but manually annotating such pairs can be expensive. Recently, the Break-It-Fix-It (BIFI) fram…

Grammatical Error CorrectionLanguage ModelingLanguage ModellingSentence+1

A BERT-based Unsupervised Grammatical Error Correction Framework

2023-03-30 · Nankai Lin, Hongbin Zhang, Menglan Shen, Yu Wang 외

Grammatical error correction (GEC) is a challenging task of natural language processing techniques. While more attempts are being made in this approach for universal languages like English or Chinese, relatively little w…

Grammatical Error CorrectionLanguage ModelingLanguage ModellingMulti-class Classification+1