Dynamic Negative Example Construction for Grammatical Error Correction using Contrastive Learning
“Grammatical error correction (GEC) aims at correcting texts with different types of grammatical errors into natural and correct forms. Due to the difference of error type distribution and error density, current grammatical error correction systems may over-correct writings and produce a low precision. To address this issue, in this paper, we propose a dynamic negative example construction method for grammatical error correction using contrastive learning. The proposed method can construct sufficient negative examples with diverse grammatical errors, and can be dynamically used during model training. The constructed negative examples are beneficial for the GEC model to correct sentences precisely and suppress the model from over-correction. Experimental results show that our proposed method enhances model precision, proving the effectiveness of our method.”
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningGrammatical Error CorrectionSimilar Papers 제목 키워드 기반
Automatic Grammatical Error Detection for Chinese based on Conditional Random Field
In the process of learning and using Chinese, foreigners may have grammatical errors due to negative migration of their native languages. Currently, the computer-oriented automatic detection method of grammatical errors …
General ClassificationGrammatical Error DetectionPart-Of-Speech TaggingExploiting Unlabeled Data for Neural Grammatical Error Detection
Identifying and correcting grammatical errors in the text written by non-native writers has received increasing attention in recent years. Although a number of annotated corpora have been established to facilitate data-d…
Binary ClassificationGeneral ClassificationGrammatical Error DetectionRE$^2$: Improving Chinese Grammatical Error Correction via Retrieving Appropriate Examples with Explanation
The primary objective of Chinese grammatical error correction (CGEC) is to detect and correct errors in Chinese sentences. Recent research shows that large language models (LLMs) have been applied to CGEC with significan…
Grammatical Error CorrectionGrammatical-Error-Aware Incorrect Example Retrieval System for Learners of Japanese as a Second Language
Existing example retrieval systems do not include grammatically incorrect examples or present only a few examples, if any. Even if a retrieval system has a wide coverage of incorrect examples along with the correct count…
Grammatical Error DetectionRetrievalSentenceSentence RetrievalChinese Grammatical Error Diagnosis Based on Policy Gradient LSTM Model
Chinese Grammatical Error Diagnosis (CGED) is a natural language processing task for the NLPTEA2018 workshop held during ACL2018. The goal of this task is to diagnose Chinese sentences containing four kinds of grammatica…
Chinese Word SegmentationSentence