ECSpell$^{UD}$: Zero-shot Domain Adaptive Chinese Spelling Check with User Dictionary
Spellers often work within a particular domain in real life. Due to lots of uncommon domain terms, experiments on our built domain specific dataset show that general models perform terribly. Inspired by the common practice of input methods, we propose to add an alterable user dictionary to handle the zero-shot domain adaption problem. Specifically, we attach a User Dictionary guided inference module (UD) to a general token classification based speller. Without extra fine-tuning, UD reveals an ability to improve the performance of all the tested spellers, especially for strong baselines. Therefore, to further make the domain adaptive speller practical, we develop a competitive general speller ECSpell which adopts the Error Consistent masking strategy to create data for pertaining. Domain experiments demonstrate that ECSpell$^{UD}$, namely ECSpell combined with UD, surpasses all the other baselines largely, even approaching the performance on the general benchmark.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain Adaptationtoken-classificationToken ClassificationSimilar Papers 제목 키워드 기반
General and Domain Adaptive Chinese Spelling Check with Error Consistent Pretraining
The lack of label data is one of the significant bottlenecks for Chinese Spelling Check (CSC). Existing researches use the method of automatic generation by exploiting unlabeled data to expand the supervised corpus. Howe…
Domain Adaptationtoken-classificationToken ClassificationRethinking Masked Language Modeling for Chinese Spelling Correction
In this paper, we study Chinese Spelling Correction (CSC) as a joint decision made by two separate models: a language model and an error model. Through empirical analysis, we find that fine-tuning BERT tends to over-fit …
DiversityDomain GeneralizationLanguage ModelingLanguage Modelling+2Measuring Massive Multitask Chinese Understanding
The development of large-scale Chinese language models is flourishing, yet there is a lack of corresponding capability assessments. Therefore, we propose a test to measure the multitask accuracy of large Chinese language…
AllRSpell: Retrieval-augmented Framework for Domain Adaptive Chinese Spelling Check
Chinese Spelling Check (CSC) refers to the detection and correction of spelling errors in Chinese texts. In practical application scenarios, it is important to make CSC models have the ability to correct errors across di…
RetrievalA Comparative Study of LLM Prompting and Fine-Tuning for Cross-genre Authorship Attribution on Chinese Lyrics
We propose a novel study on authorship attribution for Chinese lyrics, a domain where clean, public datasets are sorely lacking. Our contributions are twofold: (1) we create a new, balanced dataset of Chinese lyrics span…
Data Augmentation