Grammatical Error Correction with Contrastive Learning in Low Error Density Domains
Although grammatical error correction (GEC) has achieved good performance on texts written by learners of English as a second language, performance on low error density domains where texts are written by English speakers of varying levels of proficiency can still be improved. In this paper, we propose a contrastive learning approach to encourage the GEC model to assign a higher probability to a correct sentence while reducing the probability of incorrect sentences that the model tends to generate, so as to improve the accuracy of the model. Experimental results show that our approach significantly improves the performance of GEC models in low error density domains, when evaluated on the benchmark CWEB dataset.
Code (1)
Tasks
Contrastive LearningGrammatical Error CorrectionSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Dynamic Negative Example Construction for Grammatical Error Correction using Contrastive Learning
“Grammatical error correction (GEC) aims at correcting texts with different types of grammatical errors into natural and correct forms. Due to the difference of error type distribution and error density, current grammati…
Contrastive LearningGrammatical Error CorrectionGrammatical Error Correction in Low Error Density Domains: A New Benchmark and Analyses
Evaluation of grammatical error correction (GEC) systems has primarily focused on essays written by non-native learners of English, which however is only part of the full spectrum of GEC applications. We aim to broaden t…
Grammatical Error CorrectionLanguage ModelingLanguage ModellingN-gram Model for Chinese Grammatical Error Diagnosis
Detection and correction of Chinese grammatical errors have been two of major challenges for Chinese automatic grammatical error diagnosis.This paper presents an N-gram model for automatic detection and correction of Chi…
Language ModelingLanguage ModellingmodelChinese Grammatical Error Correction Based on Hybrid Models with Data Augmentation
A better Chinese Grammatical Error Diagnosis (CGED) system for automatic Grammatical Error Correction (GEC) can benefit foreign Chinese learners and lower Chinese learning barriers. In this paper, we introduce our soluti…
Data AugmentationGrammatical Error CorrectionCzech Grammar Error Correction with a Large and Diverse Corpus
We introduce a large and diverse Czech corpus annotated for grammatical error correction (GEC) with the aim to contribute to the still scarce data resources in this domain for languages other than English. The Grammar Er…
Grammatical Error Correction