The Uncertainty-based Retrieval Framework for Ancient Chinese CWS and POS
Automatic analysis for modern Chinese has greatly improved the accuracy of text mining in related fields, but the study of ancient Chinese is still relatively rare. Ancient text division and lexical annotation are important parts of classical literature comprehension, and previous studies have tried to construct auxiliary dictionary and other fused knowledge to improve the performance. In this paper, we propose a framework for ancient Chinese Word Segmentation and Part-of-Speech Tagging that makes a twofold effort: on the one hand, we try to capture the wordhood semantics; on the other hand, we re-predict the uncertain samples of baseline model by introducing external knowledge. The performance of our architecture outperforms pre-trained BERT with CRF and existing tools such as Jiayan.
Code (1)
Tasks
Chinese Word SegmentationPart-Of-Speech TaggingPOSRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AncientBench: Towards Comprehensive Evaluation on Excavated and Transmitted Chinese Corpora
Comprehension of ancient texts plays an important role in archaeology and understanding of Chinese history and civilization. The rapid development of large language models needs benchmarks that can evaluate their compreh…
Exploring the Capabilities of ChatGPT in Ancient Chinese Translation and Person Name Recognition
ChatGPT's proficiency in handling modern standard languages suggests potential for its use in understanding ancient Chinese. This paper explores ChatGPT's capabilities on ancient Chinese via two tasks: translating ancien…
TranslationAncient-Modern Chinese Translation with a Large Training Dataset
Ancient Chinese brings the wisdom and spirit culture of the Chinese nation. Automatic translation from ancient Chinese to modern Chinese helps to inherit and carry forward the quintessence of the ancients. However, the l…
Cultural Vocal Bursts Intensity PredictionMachine TranslationNMTTranslationAnchiBERT: A Pre-Trained Model for Ancient ChineseLanguage Understanding and Generation
Ancient Chinese is the essence of Chinese culture. There are several natural language processing tasks of ancient Chinese domain, such as ancient-modern Chinese translation, poem generation, and couplet generation. Previ…
Cultural Vocal Bursts Intensity PredictionLanguage ModelingLanguage ModellingTranslationZuo Zhuan Ancient Chinese Dataset for Word Sense Disambiguation
Word Sense Disambiguation (WSD) is a core task in Natural Language Processing (NLP). Ancient Chinese has rarely been used in WSD tasks, however, as no public dataset for ancient Chinese WSD tasks exists. Creation of an a…
Language ModelingLanguage ModellingWord Sense Disambiguation