Non-Autoregressive Grammatical Error Correction Toward a Writing Support System
There are several problems in applying grammatical error correction (GEC) to a writing support system. One of them is the handling of sentences in the middle of the input. Till date, the performance of GEC for incomplete sentences is not well-known. Hence, we analyze the performance of each model for incomplete sentences. Another problem is the correction speed. When the speed is slow, the usability of the system is limited, and the user experience is degraded. Therefore, in this study, we also focus on the non-autoregressive (NAR) model, which is a widely studied fast decoding method. We perform GEC in Japanese with traditional autoregressive and recent NAR models and analyze their accuracy and speed.
Code (0)
등록된 구현이 없습니다.
Tasks
Grammatical Error CorrectionSimilar Papers 제목 키워드 기반
Neural Predictive Text for Grammatical Error Prevention
In this paper we study the potential of two neural language models, an LSTM and an autoregressive language model GPT-2, to predict possible correction tokens in erroneous sentences and to predict the next token in random…
Grammatical Error CorrectionLanguage ModelingLanguage ModellingGEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding
Grammatical error correction (GEC) is an important NLP task that is currently usually solved with autoregressive sequence-to-sequence models. However, approaches of this class are inherently slow due to one-by-one token …
DecoderDenoisingGrammatical Error CorrectionSynthetic Data GenerationDynamic Negative Example Construction for Grammatical Error Correction using Contrastive Learning
“Grammatical error correction (GEC) aims at correcting texts with different types of grammatical errors into natural and correct forms. Due to the difference of error type distribution and error density, current grammati…
Contrastive LearningGrammatical Error CorrectionGECko+: a Grammatical and Discourse Error Correction Tool
GECko+ : a Grammatical and Discourse Error Correction Tool We introduce GECko+, a web-based writing assistance tool for English that corrects errors both at the sentence and at the discourse level. It is based on two sta…
SentenceSentence Ordering