Confusionset-guided Pointer Networks for Chinese Spelling Check
This paper proposes Confusionset-guided Pointer Networks for Chinese Spell Check (CSC) task. More concretely, our approach utilizes the off-the-shelf confusionset for guiding the character generation. To this end, our novel Seq2Seq model jointly learns to copy a correct character from an input sentence through a pointer network, or generate a character from the confusionset rather than the entire vocabulary. We conduct experiments on three human-annotated datasets, and results demonstrate that our proposed generative model outperforms all competitor models by a large margin of up to 20{\%} F1 score, achieving state-of-the-art performance on three datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers
The task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensive and time-consuming, thus the scale of …
Language ModelingLanguage ModellingSentencePHMOSpell: Phonological and Morphological Knowledge Guided Chinese Spelling Check
Chinese Spelling Check (CSC) is a challenging task due to the complex characteristics of Chinese characters. Statistics reveal that most Chinese spelling errors belong to phonological or visual errors. However, previous …
Chinese Spell CheckingLanguage ModelingLanguage ModellingA Chinese Spelling Check Framework Based on Reverse Contrastive Learning
Chinese spelling check is a task to detect and correct spelling mistakes in Chinese text. Existing research aims to enhance the text representation and use multi-source information to improve the detection and correction…
Contrastive LearningNLPTEA 2017 Shared Task -- Chinese Spelling Check
This paper provides an overview along with our findings of the Chinese Spelling Check shared task at NLPTEA 2017. The goal of this task is to develop a computer-assisted system to automatically diagnose typing errors in …
SentenceError-Robust Retrieval for Chinese Spelling Check
Chinese Spelling Check (CSC) aims to detect and correct error tokens in Chinese contexts, which has a wide range of applications. However, it is confronted with the challenges of insufficient annotated data and the issue…
RerankingRetrieval