A Syntax-Guided Grammatical Error Correction Model with Dependency Tree Correction
Grammatical Error Correction (GEC) is a task of detecting and correcting grammatical errors in sentences. Recently, neural machine translation systems have become popular approaches for this task. However, these methods lack the use of syntactic knowledge which plays an important role in the correction of grammatical errors. In this work, we propose a syntax-guided GEC model (SG-GEC) which adopts the graph attention mechanism to utilize the syntactic knowledge of dependency trees. Considering the dependency trees of the grammatically incorrect source sentences might provide incorrect syntactic knowledge, we propose a dependency tree correction task to deal with it. Combining with data augmentation method, our model achieves strong performances without using any large pre-trained models. We evaluate our model on public benchmarks of GEC task and it achieves competitive results.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationGrammatical Error CorrectionGraph AttentionMachine TranslationTranslationSimilar Papers 제목 키워드 기반
CSynGEC: Incorporating Constituent-based Syntax for Grammatical Error Correction with a Tailored GEC-Oriented Parser
Recently, Zhang et al. (2022) propose a syntax-aware grammatical error correction (GEC) approach, named SynGEC, showing that incorporating tailored dependency-based syntax of the input sentence is quite beneficial to GEC…
Grammatical Error CorrectionSentenceSynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parser
This work proposes a syntax-enhanced grammatical error correction (GEC) approach named SynGEC that effectively incorporates dependency syntactic information into the encoder part of GEC models. The key challenge for this…
Grammatical Error CorrectionSyntax RepresentationUngrammatical-syntax-based In-context Example Selection for Grammatical Error Correction
In the era of large language models (LLMs), in-context learning (ICL) stands out as an effective prompting strategy that explores LLMs' potency across various tasks. However, applying LLMs to grammatical error correction…
Grammatical Error CorrectionIn-Context LearningSyntax-guided Contrastive Learning for Pre-trained Language Model
Syntactic information has been proved to be useful for transformer-based pre-trained language models. Previous studies often rely on additional syntax-guided attention components to enhance the transformer, which require…
Contrastive LearningGrammatical Error DetectionLanguage ModelingLanguage ModellingDo Grammatical Error Correction Models Realize Grammatical Generalization?
There has been an increased interest in data generation approaches to grammatical error correction (GEC) using pseudo data. However, these approaches suffer from several issues that make them inconvenient for real-world …
Grammatical Error Correction