ChatLang-8: An LLM-Based Synthetic Data Generation Framework for Grammatical Error Correction
We explore and improve the capabilities of LLMs to generate data for grammatical error correction (GEC). When merely producing parallel sentences, their patterns are too simplistic to be valuable as a corpus. To address this issue, we propose an automated framework that includes a Subject Selector, Grammar Selector, Prompt Manager, and Evaluator. Additionally, we introduce a new dataset for GEC tasks, named ChatLang-8, which encompasses eight types of subject nouns and 23 types of grammar. It consists of 1 million pairs featuring human-like grammatical errors. Our experiments reveal that ChatLang-8 exhibits a more uniform pattern composition compared to existing GEC datasets. Furthermore, we observe improved model performance when using ChatLang-8 instead of existing GEC datasets. The experimental results suggest that our framework and ChatLang-8 are valuable resources for enhancing ChatGPT's data generation capabilities.
Code (0)
등록된 구현이 없습니다.
Tasks
Grammatical Error CorrectionSynthetic Data GenerationSimilar Papers 제목 키워드 기반
Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Models
Synthetic data generation is widely known to boost the accuracy of neural grammatical error correction (GEC) systems, but existing methods often lack diversity or are too simplistic to generate the broad range of grammat…
DiversityGrammatical Error CorrectionSentenceSynthetic Data Generation+1A Comparative Study of Synthetic Data Generation Methods for Grammatical Error Correction
Grammatical Error Correction (GEC) is concerned with correcting grammatical errors in written text. Current GEC systems, namely those leveraging statistical and neural machine translation, require large quantities of ann…
Grammatical Error CorrectionMachine TranslationSynthetic Data GenerationTranslationLLM-based Code-Switched Text Generation for Grammatical Error Correction
With the rise of globalisation, code-switching (CSW) has become a ubiquitous part of multilingual conversation, posing new challenges for natural language processing (NLP), especially in Grammatical Error Correction (GEC…
Grammatical Error CorrectionSynthetic Data GenerationText GenerationLeveraging Programmatically Generated Synthetic Data for Differentially Private Diffusion Training
Programmatically generated synthetic data has been used in differential private training for classification to enhance performance without privacy leakage. However, as the synthetic data is generated from a random proces…
Judge a Sentence by Its Content to Generate Grammatical Errors
Data sparsity is a well-known problem for grammatical error correction (GEC). Generating synthetic training data is one widely proposed solution to this problem, and has allowed models to achieve state-of-the-art (SOTA) …
Grammatical Error CorrectionSentenceSynthetic Data Generation