Papers Chinese Word Segmentation
“Chinese Word Segmentation” 태그가 달린 논문 245편 · 필터 해제
Chinese Word Boundary Recovery through Character Alignment Projection
Chinese word segmentation is especially fragile in non-standard text, where language learner errors and other character-level divergences disrupt the word boundaries assumed by downstream annotation and evaluation. This …
Chinese Word SegmentationParsing Through Boundaries in Chinese Word Segmentation
Chinese word segmentation is a foundational task in natural language processing (NLP), with far-reaching effects on syntactic analysis. Unlike alphabetic languages like English, Chinese lacks explicit word boundaries, ma…
Chinese Word SegmentationSegmentationMining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation
Inspired by early research on exploring naturally annotated data for Chinese Word Segmentation (CWS), and also by recent research on integration of speech and text processing, this work for the first time proposes to exp…
Chinese Word SegmentationLegal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model
With the development of large-scale Language Models (LLM), fine-tuning pre-trained LLM has become a mainstream paradigm for solving downstream tasks of natural language processing. However, training a language model in t…
Chinese Word SegmentationLanguage ModelingLanguage ModellingLarge Language ModelAn Effective Incorporating Heterogeneous Knowledge Curriculum Learning for Sequence Labeling
Sequence labeling models often benefit from incorporating external knowledge. However, this practice introduces data heterogeneity and complicates the model with additional modules, leading to increased expenses for trai…
Chinese Word SegmentationPart-Of-Speech TaggingPOSThe Uncertainty-based Retrieval Framework for Ancient Chinese CWS and POS
Automatic analysis for modern Chinese has greatly improved the accuracy of text mining in related fields, but the study of ancient Chinese is still relatively rare. Ancient text division and lexical annotation are import…
Chinese Word SegmentationPart-Of-Speech TaggingPOSRetrievalIncorporating Deep Syntactic and Semantic Knowledge for Chinese Sequence Labeling with GCN
Recently, it is quite common to integrate Chinese sequence labeling results to enhance syntactic and semantic parsing. However, little attention has been paid to the utility of hierarchy and structure information encoded…
Chinese Word SegmentationPart-Of-Speech TaggingSemantic ParsingLATTE: Lattice ATTentive Encoding for Character-based Word Segmentation
A character sequence comprises at least one or more segmentation alternatives. This can be considered segmentation ambiguity and may weaken segmentation performance in word segmentation. Proper handling of such ambiguity…
Chinese Word SegmentationJapanese Word SegmentationSegmentationThai Word SegmentationAncient Chinese Word Segmentation and Part-of-Speech Tagging Using Distant Supervision
Ancient Chinese word segmentation (WSG) and part-of-speech tagging (POS) are important to study ancient Chinese, but the amount of ancient Chinese WSG and POS tagging data is still rare. In this paper, we propose a novel…
Chinese Word SegmentationMemorizationPart-Of-Speech TaggingPOS+1GNN-SL: Sequence Labeling Based on Nearest Examples via GNN
To better handle long-tail cases in the sequence labeling (SL) task, in this work, we introduce graph neural networks sequence labeling (GNN-SL), which augments the vanilla SL model output with similar tagging examples r…
Chinese Word Segmentationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3Joint Chinese Word Segmentation and Span-based Constituency Parsing
In constituency parsing, span-based decoding is an important direction. However, for Chinese sentences, because of their linguistic characteristics, it is necessary to utilize other models to perform word segmentation fi…
Chinese Word SegmentationConstituency ParsingSegmentationMultifaceted Assessments of Traditional Chinese Word Segmentation Tool on Large Corpora
This study aims to evaluate three most popular word segmentation tool for a large Traditional Chinese corpus in terms of their efficiency, resource consumption, and cost. Specifically, we compare the performances of Jieb…
Chinese Word SegmentationGPUnamed-entity-recognitionNamed Entity Recognition+3Mining Word Boundaries in Speech as Naturally Annotated Word Segmentation Data
Inspired by early research on exploring naturally annotated data for Chinese word segmentation (CWS), and also by recent research on integration of speech and text processing, this work for the first time proposes to min…
Chinese Word SegmentationUnsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling
Boundary information is critical for various Chinese language processing tasks, such as word segmentation, part-of-speech tagging, and named entity recognition. Previous studies usually resorted to the use of a high-qual…
Chinese Named Entity RecognitionChinese Word SegmentationLanguage ModelingLanguage Modelling+3基于神经网络的半监督CRF中文分词(Semi-supervised CRF Chinese Word Segmentation based on Neural Network)
“分词是中文信息处理的基础任务之一。目前全监督中文分词技术已相对成熟并在通用领域取得较好效果,但全监督方法存在依赖大规模标注语料且领域迁移能力差的问题,特别是跨领域未登录词识别性能不佳。为缓解上述问题,本文提出了一种充分利用相对易得的目标领域无标注文本、实现跨领域迁移的半监督中文分词框架;并设计实现了基于词记忆网络和序列条件熵的半监督权杒杆中文分词模型。实验结果表明本该模型在多个领域数据集上杆札值和杒杏杏杖值分别取得最高朲.朳朵朥和朱朲…
Chinese Word SegmentationThat Slepen Al the Nyght with Open Ye! Cross-era Sequence Segmentation with Switch-memory
The evolution of language follows the rule of gradual change. Grammar, vocabulary, and lexical semantic shifts take place over time, resulting in a diachronic linguistic gap. As such, a considerable amount of texts are w…
Chinese Word SegmentationMachine TranslationSegmentationTranslationChiMST: A Chinese Medical Corpus for Word Segmentation and Medical Term Recognition
Chinese word segmentation (CWS) and named entity recognition (NER) are two important tasks in Chinese natural language processing. To achieve good model performance on these tasks, existing neural approaches normally req…
Chinese Word Segmentationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1The First International Ancient Chinese Word Segmentation and POS Tagging Bakeoff: Overview of the EvaHan 2022 Evaluation Campaign
This paper presents the results of the First Ancient Chinese Word Segmentation and POS Tagging Bakeoff (EvaHan), which was held at the Second Workshop on Language Technologies for Historical and Ancient Languages (LT4HAL…
Chinese Word SegmentationPOSPOS TaggingSegmentationAncient Chinese Word Segmentation and Part-of-Speech Tagging Using Data Augmentation
We attended the EvaHan2022 ancient Chinese word segmentation and Part-of-Speech (POS) tagging evaluation. We regard the Chinese word segmentation and POS tagging as sequence tagging tasks. Our system is based on a BERT-B…
Chinese Word SegmentationData AugmentationPart-Of-Speech TaggingPOS+2BERT 4EVER@EvaHan 2022: Ancient Chinese Word Segmentation and Part-of-Speech Tagging Based on Adversarial Learning and Continual Pre-training
With the development of artificial intelligence (AI) and digital humanities, ancient Chinese resources and language technology have also developed and grown, which have become an increasingly important part to the study …
Chinese Word SegmentationCultural Vocal Bursts Intensity PredictionEnsemble LearningPart-Of-Speech Tagging+3