Comparison of Grammatical Error Correction Using Back-Translation Models
Grammatical error correction (GEC) suffers from a lack of sufficient parallel data. Therefore, GEC studies have developed various methods to generate pseudo data, which comprise pairs of grammatical and artificially produced ungrammatical sentences. Currently, a mainstream approach to generate pseudo data is back-translation (BT). Most previous GEC studies using BT have employed the same architecture for both GEC and BT models. However, GEC models have different correction tendencies depending on their architectures. Thus, in this study, we compare the correction tendencies of the GEC models trained on pseudo data generated by different BT models, namely, Transformer, CNN, and LSTM. The results confirm that the correction tendencies for each error type are different for every BT model. Additionally, we examine the correction tendencies when using a combination of pseudo data generated by different BT models. As a result, we find that the combination of different BT models improves or interpolates the F_0.5 scores of each error type compared with that of single BT models with different seeds.
Code (0)
등록된 구현이 없습니다.
Tasks
Grammatical Error CorrectionTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Grammatical Error Generation Based on Translated Fragments
We perform neural machine translation of sentence fragments in order to create large amounts of training data for English grammatical error correction. Our method aims at simulating mistakes made by second language learn…
Grammatical Error CorrectionMachine TranslationSentenceTranslationCool English: a Grammatical Error Correction System Based on Large Learner Corpora
This paper presents a grammatical error correction (GEC) system that provides corrective feedback for essays. We apply the sequence-to-sequence model, which is frequently used in machine translation and text summarizatio…
Grammatical Error CorrectionMachine TranslationText SummarizationTranslationMiSS: An Assistant for Multi-Style Simultaneous Translation
In this paper, we present MiSS, an assistant for multi-style simultaneous translation. Our proposed translation system has five key features: highly accurate translation, simultaneous translation, translation for multipl…
Grammatical Error CorrectionMachine TranslationTranslationNeural and FST-based approaches to grammatical error correction
In this paper, we describe our submission to the BEA 2019 shared task on grammatical error correction. We present a system pipeline that utilises both error detection and correction models. The input text is first correc…
Grammatical Error CorrectionMachine TranslationMulti-Task LearningRe-Ranking+1Pseudo-Error Generation for Grammatical Error Correction Based on Learner’s First Language
We propose to adapt grammatical error correction (GEC) systems to the learners' first language (L1) by generating artificial errors that reflect the L1 influence. To this end, we employ two simple approaches: fine-tuning…
Grammatical Error CorrectionTranslation