paper-with-me

홈 › Papers

Improving Chinese Spelling Check by Character Pronunciation Prediction: The Effects of Adaptivity and Granularity

2022-10-20 · Jiahao Li, Quan Wang, Zhendong Mao, Junbo Guo, Yanyan Yang, Yongdong Zhang

Chinese spelling check (CSC) is a fundamental NLP task that detects and corrects spelling errors in Chinese texts. As most of these spelling errors are caused by phonetic similarity, effectively modeling the pronunciation of Chinese characters is a key factor for CSC. In this paper, we consider introducing an auxiliary task of Chinese pronunciation prediction (CPP) to improve CSC, and, for the first time, systematically discuss the adaptivity and granularity of this auxiliary task. We propose SCOPE which builds on top of a shared encoder two parallel decoders, one for the primary CSC task and the other for a fine-grained auxiliary CPP task, with a novel adaptive weighting scheme to balance the two tasks. In addition, we design a delicate iterative correction strategy for further improvements during inference. Empirical evaluation shows that SCOPE achieves new state-of-the-art on three CSC benchmarks, demonstrating the effectiveness and superiority of the auxiliary CPP task. Comprehensive ablation studies further verify the positive effects of adaptivity and granularity of the task. Code and data used in this paper are publicly available at https://github.com/jiahaozhenbang/SCOPE.

📄 PDF Abstract BibTeX arXiv:2210.10996

Code (1)

jiahaozhenbang/scope 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Chunk-based Chinese Spelling Check with Global Optimization

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Zuyi Bao, Chen Li, Rui Wang

Chinese spelling check is a challenging task due to the characteristics of the Chinese language, such as the large character set, no word boundary, and short word length. On the one hand, most of the previous works only …

global-optimizationOptical Character RecognitionOptical Character Recognition (OCR)Sentence

PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction

2021-08-01 · ACL 2021 5 · Shulin Liu, Tao Yang, Tianchi Yue, Feng Zhang 외

Chinese spelling correction (CSC) is a task to detect and correct spelling errors in texts. CSC is essentially a linguistic problem, thus the ability of language understanding is crucial to this task. In this paper, we p…

Language ModelingLanguage ModellingSpelling Correction

CSCD-NS: a Chinese Spelling Check Dataset for Native Speakers

2022-11-16 · Yong Hu, Fandong Meng, Jie zhou

In this paper, we present CSCD-NS, the first Chinese spelling check (CSC) dataset designed for native speakers, containing 40,000 samples from a Chinese social platform. Compared with existing CSC datasets aimed at Chine…

Spelling Correction

A Chinese Spelling Check Framework Based on Reverse Contrastive Learning

2022-10-25 · Nankai Lin, Hongyan Wu, Sihui Fu, Shengyi Jiang 외

Chinese spelling check is a task to detect and correct spelling mistakes in Chinese text. Existing research aims to enhance the text representation and use multi-source information to improve the detection and correction…

Contrastive Learning

Exploring the Usage of Chinese Pinyin in Pretraining

2023-10-08 · Baojun Wang, Kun Xu, Lifeng Shang

Unlike alphabetic languages, Chinese spelling and pronunciation are different. Both characters and pinyin take an important role in Chinese language understanding. In Chinese NLP tasks, we almost adopt characters or word…

Language Modelling