paper-with-me

홈 › Papers

ECSpell$^{UD}$: Zero-shot Domain Adaptive Chinese Spelling Check with User Dictionary

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Spellers often work within a particular domain in real life. Due to lots of uncommon domain terms, experiments on our built domain specific dataset show that general models perform terribly. Inspired by the common practice of input methods, we propose to add an alterable user dictionary to handle the zero-shot domain adaption problem. Specifically, we attach a User Dictionary guided inference module (UD) to a general token classification based speller. Without extra fine-tuning, UD reveals an ability to improve the performance of all the tested spellers, especially for strong baselines. Therefore, to further make the domain adaptive speller practical, we develop a competitive general speller ECSpell which adopts the Error Consistent masking strategy to create data for pertaining. Domain experiments demonstrate that ECSpell$^{UD}$, namely ECSpell combined with UD, surpasses all the other baselines largely, even approaching the performance on the general benchmark.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Adaptationtoken-classificationToken Classification

Similar Papers 제목 키워드 기반

General and Domain Adaptive Chinese Spelling Check with Error Consistent Pretraining

2022-03-21 · Qi Lv, Ziqiang Cao, Lei Geng, Chunhui Ai 외

The lack of label data is one of the significant bottlenecks for Chinese Spelling Check (CSC). Existing researches use the method of automatic generation by exploiting unlabeled data to expand the supervised corpus. Howe…

Domain Adaptationtoken-classificationToken Classification

Rethinking Masked Language Modeling for Chinese Spelling Correction

2023-05-28 · Hongqiu Wu, Shaohua Zhang, Yuchen Zhang, Hai Zhao

In this paper, we study Chinese Spelling Correction (CSC) as a joint decision made by two separate models: a language model and an error model. Through empirical analysis, we find that fine-tuning BERT tends to over-fit …

DiversityDomain GeneralizationLanguage ModelingLanguage Modelling+2

Measuring Massive Multitask Chinese Understanding

2023-04-25 · Hui Zeng

The development of large-scale Chinese language models is flourishing, yet there is a lack of corresponding capability assessments. Therefore, we propose a test to measure the multitask accuracy of large Chinese language…

All

RSpell: Retrieval-augmented Framework for Domain Adaptive Chinese Spelling Check

2023-08-16 · Siqi Song, Qi Lv, Lei Geng, Ziqiang Cao 외

Chinese Spelling Check (CSC) refers to the detection and correction of spelling errors in Chinese texts. In practical application scenarios, it is important to make CSC models have the ability to correct errors across di…

Retrieval

A Comparative Study of LLM Prompting and Fine-Tuning for Cross-genre Authorship Attribution on Chinese Lyrics

2025-11-26 · Yuxin Li, Lorraine Xu, Meng Fan Wang arxiv

We propose a novel study on authorship attribution for Chinese lyrics, a domain where clean, public datasets are sorely lacking. Our contributions are twofold: (1) we create a new, balanced dataset of Chinese lyrics span…

Data Augmentation