paper-with-me

Papers

Comparison of Grammatical Error Correction Using Back-Translation Models

2021-04-16 · NAACL 2021 4 · Aomi Koyama, Kengo Hotate, Masahiro Kaneko, Mamoru Komachi

Grammatical error correction (GEC) suffers from a lack of sufficient parallel data. Therefore, GEC studies have developed various methods to generate pseudo data, which comprise pairs of grammatical and artificially produced ungrammatical sentences. Currently, a mainstream approach to generate pseudo data is back-translation (BT). Most previous GEC studies using BT have employed the same architecture for both GEC and BT models. However, GEC models have different correction tendencies depending on their architectures. Thus, in this study, we compare the correction tendencies of the GEC models trained on pseudo data generated by different BT models, namely, Transformer, CNN, and LSTM. The results confirm that the correction tendencies for each error type are different for every BT model. Additionally, we examine the correction tendencies when using a combination of pseudo data generated by different BT models. As a result, we find that the combination of different BT models improves or interpolates the F_0.5 scores of each error type compared with that of single BT models with different seeds.

📄 PDF Abstract BibTeX arXiv:2104.07848

Code (0)

등록된 구현이 없습니다.

Tasks

Grammatical Error CorrectionTranslation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Grammatical Error Generation Based on Translated Fragments

2021-04-20 · NoDaLiDa 2021 5 · Eetu Sjöblom, Mathias Creutz, Teemu Vahtola

We perform neural machine translation of sentence fragments in order to create large amounts of training data for English grammatical error correction. Our method aims at simulating mistakes made by second language learn…

Grammatical Error CorrectionMachine TranslationSentenceTranslation

Cool English: a Grammatical Error Correction System Based on Large Learner Corpora

2018-08-01 · COLING 2018 8 · Yu-Chun Lo, Jhih-Jie Chen, Ching-Yu Yang, Jason Chang

This paper presents a grammatical error correction (GEC) system that provides corrective feedback for essays. We apply the sequence-to-sequence model, which is frequently used in machine translation and text summarizatio…

Grammatical Error CorrectionMachine TranslationText SummarizationTranslation

MiSS: An Assistant for Multi-Style Simultaneous Translation

2021-11-01 · EMNLP (ACL) 2021 11 · Zuchao Li, Kevin Parnow, Masao Utiyama, Eiichiro Sumita 외

In this paper, we present MiSS, an assistant for multi-style simultaneous translation. Our proposed translation system has five key features: highly accurate translation, simultaneous translation, translation for multipl…

Grammatical Error CorrectionMachine TranslationTranslation

Neural and FST-based approaches to grammatical error correction

2019-08-01 · WS 2019 8 · Zheng Yuan, Felix Stahlberg, Marek Rei, Bill Byrne 외

In this paper, we describe our submission to the BEA 2019 shared task on grammatical error correction. We present a system pipeline that utilises both error detection and correction models. The input text is first correc…

Grammatical Error CorrectionMachine TranslationMulti-Task LearningRe-Ranking+1

Pseudo-Error Generation for Grammatical Error Correction Based on Learner’s First Language

2021-09-17 · ACL ARR September 2021 9 · Anonymous

We propose to adapt grammatical error correction (GEC) systems to the learners' first language (L1) by generating artificial errors that reflect the L1 influence. To this end, we employ two simple approaches: fine-tuning…

Grammatical Error CorrectionTranslation