Comparison of the Impact of Word Segmentation on Name Tagging for Chinese and Japanese
Word Segmentation is usually considered an essential step for many Chinese and Japanese Natural Language Processing tasks, such as name tagging. This paper presents several new observations and analysis on the impact of word segmentation on name tagging; (1). Due to the limitation of current state-of-the-art Chinese word segmentation performance, a character-based name tagger can outperform its word-based counterparts for Chinese but not for Japanese; (2). It is crucial to keep segmentation settings (e.g. definitions, specifications, methods) consistent between training and testing for name tagging; (3). As long as (2) is ensured, the performance of word segmentation does not have appreciable impact on Chinese and Japanese name tagging.
Code (0)
등록된 구현이 없습니다.
Tasks
Chinese Word SegmentationSegmentationSimilar Papers 제목 키워드 기반
From Word Segmentation to POS Tagging for Vietnamese
This paper presents an empirical comparison of two strategies for Vietnamese Part-of-Speech (POS) tagging from unsegmented text: (i) a pipeline strategy where we consider the output of a word segmenter as the input of a …
Part-Of-Speech TaggingPOSPOS TaggingTAGA neural joint model for Vietnamese word segmentation, POS tagging and dependency parsing
We propose the first multi-task learning model for joint Vietnamese word segmentation, part-of-speech (POS) tagging and dependency parsing. In particular, our model extends the BIST graph-based dependency parser (Kiperwa…
Dependency ParsingMulti-Task LearningPart-Of-Speech TaggingPOS+3Augmenting Part-of-speech Tagging with Syntactic Information for Vietnamese and Chinese
Word segmentation and part-of-speech tagging are two critical preliminary steps for downstream tasks in Vietnamese natural language processing. In reality, people tend to consider also the phrase boundary when performing…
Part-Of-Speech TaggingSegmentationMultifaceted Assessments of Traditional Chinese Word Segmentation Tool on Large Corpora
This study aims to evaluate three most popular word segmentation tool for a large Traditional Chinese corpus in terms of their efficiency, resource consumption, and cost. Specifically, we compare the performances of Jieb…
Chinese Word SegmentationGPUnamed-entity-recognitionNamed Entity Recognition+3Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-stage Span Labeling
Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word se…
Chinese Word SegmentationPart-Of-Speech TaggingSegmentationTAG