A Self-Refinement Strategy for Noise Reduction in Grammatical Error Correction
Existing approaches for grammatical error correction (GEC) largely rely on supervised learning with manually created GEC datasets. However, there has been little focus on verifying and ensuring the quality of the datasets, and on how lower-quality data might affect GEC performance. We indeed found that there is a non-negligible amount of "noise" where errors were inappropriately edited or left uncorrected. To address this, we designed a self-refinement method where the key idea is to denoise these datasets by leveraging the prediction consistency of existing models, and outperformed strong denoising baseline methods. We further applied task-specific techniques and achieved state-of-the-art performance on the CoNLL-2014, JFLEG, and BEA-2019 benchmarks. We then analyzed the effect of the proposed denoising method, and found that our approach leads to improved coverage of corrections and facilitated fluency edits which are reflected in higher recall and overall performance.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingGrammatical Error CorrectionSimilar Papers 제목 키워드 기반
Mitigating Instance-Dependent Label Noise: Integrating Self-Supervised Pretraining with Pseudo-Label Refinement
Deep learning models rely heavily on large volumes of labeled data to achieve high performance. However, real-world datasets often contain noisy labels due to human error, ambiguity, or resource constraints during the an…
Pseudo LabelSelf-Supervised LearningSimple Self-Conditioning Adaptation for Masked Diffusion Models
Masked diffusion models (MDMs) generate discrete sequences by iterative denoising under an absorbing masking process. In standard masked diffusion, if a token remains masked after a reverse update, the model discards its…
Self-Supervised Iterative Refinement for Anomaly Detection in Industrial Quality Control
This study introduces the Iterative Refinement Process (IRP), a robust anomaly detection methodology designed for high-stakes industrial quality control. The IRP enhances defect detection accuracy through a cyclic data r…
Anomaly DetectionDefect DetectionSelf-Supervised Anomaly DetectionSelf-Distilled Depth Refinement with Noisy Poisson Fusion
Depth refinement aims to infer high-resolution depth with fine-grained edges and details, refining low-resolution results of depth estimation models. The prevailing methods adopt tile-based manners by merging numerous pa…
Depth EstimationHGSLoc: 3DGS-based Heuristic Camera Pose Refinement
Visual localization refers to the process of determining camera poses and orientation within a known scene representation. This task is often complicated by factors such as illumination changes and variations in viewing …
3DGS3D ReconstructionNeRFNeural Rendering+2