Neural Network Translation Models for Grammatical Error Correction
Phrase-based statistical machine translation (SMT) systems have previously been used for the task of grammatical error correction (GEC) to achieve state-of-the-art accuracy. The superiority of SMT systems comes from their ability to learn text transformations from erroneous to corrected text, without explicitly modeling error types. However, phrase-based SMT systems suffer from limitations of discrete word representation, linear mapping, and lack of global context. In this paper, we address these limitations by using two different yet complementary neural network models, namely a neural network global lexicon model and a neural network joint model. These neural networks can generalize better by using continuous space representation of words and learn non-linear mappings. Moreover, they can leverage contextual information from the source sentence more effectively. By adding these two components, we achieve statistically significant improvement in accuracy for grammatical error correction over a state-of-the-art GEC system.
Code (2)
Tasks
Grammatical Error CorrectionMachine TranslationSentenceTranslationSimilar Papers 제목 키워드 기반
Neural Machine Translation of Text from Non-Native Speakers
Neural Machine Translation (NMT) systems are known to degrade when confronted with noisy data, especially when the system is trained only on clean data. In this paper, we show that augmenting training data with sentences…
Machine TranslationNMTTranslationA Comparative Study of Synthetic Data Generation Methods for Grammatical Error Correction
Grammatical Error Correction (GEC) is concerned with correcting grammatical errors in written text. Current GEC systems, namely those leveraging statistical and neural machine translation, require large quantities of ann…
Grammatical Error CorrectionMachine TranslationSynthetic Data GenerationTranslationComparison of Grammatical Error Correction Using Back-Translation Models
Grammatical error correction (GEC) suffers from a lack of sufficient parallel data. Therefore, GEC studies have developed various methods to generate pseudo data, which comprise pairs of grammatical and artificially prod…
Grammatical Error CorrectionTranslationImproving Grammatical Error Correction with Machine Translation Pairs
We propose a novel data synthesis method to generate diverse error-corrected sentence pairs for improving grammatical error correction, which is based on a pair of machine translation models of different qualities (i.e.,…
Grammatical Error CorrectionLanguage ModelingLanguage ModellingMachine Translation+2(Almost) Unsupervised Grammatical Error Correction using Synthetic Comparable Corpus
We introduce unsupervised techniques based on phrase-based statistical machine translation for grammatical error correction (GEC) trained on a pseudo learner corpus created by Google Translation. We verified our GEC syst…
Grammatical Error CorrectionMachine TranslationTranslation