Chinese Word Segmentation
6개 벤치마크 · 논문 245편 · 이 태스크의 논문 보기 →
Benchmarks
Most implemented
ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations
PKUSEG: A Toolkit for Multi-Domain Chinese Word Segmentation
Simplifying Neural Machine Translation with Addition-Subtraction Twin-Gated Recurrent Networks
LATTE: Lattice ATTentive Encoding for Character-based Word Segmentation
Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling
Sub-Character Tokenization for Chinese Pretrained Language Models
Papers
Chinese Word Boundary Recovery through Character Alignment Projection
Chinese word segmentation is especially fragile in non-standard text, where language learner errors and other character-level divergences disrupt the word boundaries assumed by downstream annotation and evaluation. This …
Chinese Word SegmentationParsing Through Boundaries in Chinese Word Segmentation
Chinese word segmentation is a foundational task in natural language processing (NLP), with far-reaching effects on syntactic analysis. Unlike alphabetic languages like English, Chinese lacks explicit word boundaries, ma…
Chinese Word SegmentationSegmentationMining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation
Inspired by early research on exploring naturally annotated data for Chinese Word Segmentation (CWS), and also by recent research on integration of speech and text processing, this work for the first time proposes to exp…
Chinese Word SegmentationLegal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model
With the development of large-scale Language Models (LLM), fine-tuning pre-trained LLM has become a mainstream paradigm for solving downstream tasks of natural language processing. However, training a language model in t…
Chinese Word SegmentationLanguage ModelingLanguage ModellingLarge Language ModelAn Effective Incorporating Heterogeneous Knowledge Curriculum Learning for Sequence Labeling
Sequence labeling models often benefit from incorporating external knowledge. However, this practice introduces data heterogeneity and complicates the model with additional modules, leading to increased expenses for trai…
Chinese Word SegmentationPart-Of-Speech TaggingPOSThe Uncertainty-based Retrieval Framework for Ancient Chinese CWS and POS
Automatic analysis for modern Chinese has greatly improved the accuracy of text mining in related fields, but the study of ancient Chinese is still relatively rare. Ancient text division and lexical annotation are import…
Chinese Word SegmentationPart-Of-Speech TaggingPOSRetrieval