From Chinese Word Segmentation to Extraction of Constructions: Two Sides of the Same Algorithmic Coin
This paper presents the results of two experiments carried out within the framework of computational construction grammar. Starting from the constructionist point of view that there are just constructions in language, including lexical ones, we tested the validity of a clustering algorithm that was primarily designed for MWE extraction, the cpr-score (Colson, 2017), on Chinese word segmentation. Our results indicate a striking recall rate of 75 percent without any special adaptation to Chinese or to the lexicon, which confirms that there is some similarity between extracting MWEs and CWS. Our second experiment also suggests that the same methodology might be used for extracting more schematic or abstract constructions, thereby providing evidence for the statistical foundation of construction grammar.
Code (0)
등록된 구현이 없습니다.
Tasks
Chinese Word SegmentationClusteringSimilar Papers 제목 키워드 기반
Ancient Chinese Word Segmentation and Part-of-Speech Tagging Using Data Augmentation
We attended the EvaHan2022 ancient Chinese word segmentation and Part-of-Speech (POS) tagging evaluation. We regard the Chinese word segmentation and POS tagging as sequence tagging tasks. Our system is based on a BERT-B…
Chinese Word SegmentationData AugmentationPart-Of-Speech TaggingPOS+2A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing
Chinese word segmentation and dependency parsing are two fundamental tasks for Chinese natural language processing. The dependency parsing is defined on word-level. Therefore word segmentation is the precondition of depe…
Chinese Word SegmentationDependency ParsingFeature EngineeringLanguage Modeling+2Improving Patent Translation using Bilingual Term Extraction and Re-tokenization for Chinese--Japanese
Unlike European languages, many Asian languages like Chinese and Japanese do not have typographic boundaries in written system. Word segmentation (tokenization) that break sentences down into individual words (tokens) is…
Chinese Word SegmentationMachine TranslationSegmentationTerm Extraction+1Span Labeling Approach for Vietnamese and Chinese Word Segmentation
In this paper, we propose a span labeling approach to model n-gram information for Vietnamese word segmentation, namely SPAN SEG. We compare the span labeling approach with the conditional random field by using encoders …
Chinese Word SegmentationLanguage ModelingLanguage ModellingSegmentation+1Unified Multi-Criteria Chinese Word Segmentation with BERT
Multi-Criteria Chinese Word Segmentation (MCCWS) aims at finding word boundaries in a Chinese sentence composed of continuous characters while multiple segmentation criteria exist. The unified framework has been widely u…
Chinese Word SegmentationLanguage ModelingLanguage ModellingMulti-Task Learning+2