Non-Deterministic Segmentation for Chinese Lattice Parsing
Parsing Chinese critically depends on correct word segmentation for the parser since incorrect segmentation inevitably causes incorrect parses. We investigate a pipeline approach to segmentation and parsing using word lattices as parser input. We compare CRF-based and lexicon-based approaches to word segmentation. Our results show that the lattice parser is capable of selecting the correction segmentation from thousands of options, thus drastically reducing the number of unparsed sentence. Lexicon-based parsing models have a better coverage than the CRF-based approach, but the many options are more difficult to handle. We reach our best result by using a lexicon from the n-best CRF analyses, combined with highly probable words.
Code (0)
등록된 구현이 없습니다.
Tasks
Morphological AnalysisSegmentationSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Lattice-based Framework for Joint Chinese Word Segmentation, POS Tagging and Parsing
A Graph-based Lattice Dependency Parser for Joint Morphological Segmentation and Syntactic Analysis
Space-delimited words in Turkish and Hebrew text can be further segmented into meaningful units, but syntactic and semantic context is necessary to predict segmentation. At the same time, predicting correct syntactic str…
Dependency ParsingMorphological AnalysisMorphological TaggingSegmentation+1End-to-End Chinese Parsing Exploiting Lexicons
Chinese parsing has traditionally been solved by three pipeline systems including word-segmentation, part-of-speech tagging and dependency parsing modules. In this paper, we propose an end-to-end Chinese parsing model ba…
Dependency ParsingGraph AttentionPart-Of-Speech TaggingSegmentationA Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing
Chinese word segmentation and dependency parsing are two fundamental tasks for Chinese natural language processing. The dependency parsing is defined on word-level. Therefore word segmentation is the precondition of depe…
Chinese Word SegmentationDependency ParsingFeature EngineeringLanguage Modeling+2Joint Chinese Word Segmentation and Span-based Constituency Parsing
In constituency parsing, span-based decoding is an important direction. However, for Chinese sentences, because of their linguistic characteristics, it is necessary to utilize other models to perform word segmentation fi…
Chinese Word SegmentationConstituency ParsingSegmentation