paper-with-me

홈 › Papers

An Error-Guided Correction Model for Chinese Spelling Error Correction

2023-01-16 · Rui Sun, Xiuyu Wu, Yunfang Wu

Although existing neural network approaches have achieved great success on Chinese spelling correction, there is still room to improve. The model is required to avoid over-correction and to distinguish a correct token from its phonological and visually similar ones. In this paper, we propose an error-guided correction model (EGCM) to improve Chinese spelling correction. By borrowing the powerful ability of BERT, we propose a novel zero-shot error detection method to do a preliminary detection, which guides our model to attend more on the probably wrong tokens in encoding and to avoid modifying the correct tokens in generating. Furthermore, we introduce a new loss function to integrate the error confusion set, which enables our model to distinguish easily misused tokens. Moreover, our model supports highly parallel decoding to meet real application requirements. Experiments are conducted on widely used benchmarks. Our model achieves superior performance against state-of-the-art approaches by a remarkable margin, on both the correction quality and computation speed.

📄 PDF Abstract BibTeX arXiv:2301.06323

Code (1)

ruisun1/Mask-Predict-main 공식 구현

Tasks

Chinese Spelling Error CorrectionSpelling Correction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Weight Decay 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

ChineseErrorCorrector3-4B: State-of-the-Art Chinese Spelling and Grammar Corrector

2025-11-13 · Wei Tian, YuhaoZhou arxiv

This paper introduces ChineseErrorCorrector3-4B, a unified model for Chinese spelling and grammatical error correction based on Qwen3-4B. The model demonstrates outstanding performance in general text correction tasks an…

Grammatical Error Correction

CCTC: A Cross-Sentence Chinese Text Correction Dataset for Native Speakers

2022-10-01 · COLING 2022 10 · Baoxin Wang, Xingyi Duan, Dayong Wu, Wanxiang Che 외

The Chinese text correction (CTC) focuses on detecting and correcting Chinese spelling errors and grammatical errors. Most existing datasets of Chinese spelling check (CSC) and Chinese grammatical error correction (GEC) …

Grammatical Error CorrectionSentence

uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers

2022-09-15 · COLING 2022 10 · Piji Li

The task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensive and time-consuming, thus the scale of …

Language ModelingLanguage ModellingSentence

From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correction

2022-11-03 · Xiuyu Wu, Yunfang Wu

Chinese Grammatical Error Correction (CGEC) aims to generate a correct sentence from an erroneous sequence, where different kinds of errors are mixed. This paper divides the CGEC task into two steps, namely spelling erro…

Data AugmentationGrammatical Error CorrectionPOSSentence

Chinese Grammatical Error Correction Based on Hybrid Models with Data Augmentation

2020-12-01 · AACL (NLP-TEA) 2020 12 · Yi Wang, Ruibin Yuan, Yan‘gen Luo, Yufang Qin 외

A better Chinese Grammatical Error Diagnosis (CGED) system for automatic Grammatical Error Correction (GEC) can benefit foreign Chinese learners and lower Chinese learning barriers. In this paper, we introduce our soluti…

Data AugmentationGrammatical Error Correction