Attention Is All You Need for Chinese Word Segmentation
Taking greedy decoding algorithm as it should be, this work focuses on further strengthening the model itself for Chinese word segmentation (CWS), which results in an even more fast and more accurate CWS model. Our model consists of an attention only stacked encoder and a light enough decoder for the greedy segmentation plus two highway connections for smoother training, in which the encoder is composed of a newly proposed Transformer variant, Gaussian-masked Directional (GD) Transformer, and a biaffine attention scorer. With the effective encoder design, our model only needs to take unigram features for scoring. Our model is evaluated on SIGHAN Bakeoff benchmark datasets. The experimental results show that with the highest segmentation speed, the proposed model achieves new state-of-the-art or comparable performance against strong baselines in terms of strict closed test setting.
Code (1)
Tasks
AllChinese Word SegmentationDecoderSegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A New Clustering neural network for Chinese word segmentation
In this article I proposed a new model to achieve Chinese word segmentation(CWS),which may have the potentiality to apply in other domains in the future.It is a new thinking in CWS compared to previous works,to consider …
Chinese Word SegmentationClusteringSegmentationSentenceInvestigating Self-Attention Network for Chinese Word Segmentation
Neural network has become the dominant method for Chinese word segmentation. Most existing models cast the task as sequence labeling, using BiLSTM-CRF for representing the input and making output predictions. Recently, a…
Chinese Word SegmentationSegmentationJoint Chinese Word Segmentation and Part-of-speech Tagging via Two-way Attentions of Auto-analyzed Knowledge
Chinese word segmentation (CWS) and part-of-speech (POS) tagging are important fundamental tasks for Chinese language processing, where joint learning of them is an effective one-step solution for both tasks. Previous st…
Chinese Word SegmentationPart-Of-Speech TaggingPOSPOS TaggingIncorporating Uncertain Segmentation Information into Chinese NER for Social Media Text
Chinese word segmentation is necessary to provide word-level information for Chinese named entity recognition (NER) systems. However, segmentation error propagation is a challenge for Chinese NER while processing colloqu…
Chinese Named Entity RecognitionChinese Word Segmentationnamed-entity-recognitionNamed Entity Recognition+5Combine CRF and MMSEG to Boost Chinese Word Segmentation in Social Media
In this paper, we propose a joint algorithm for the word segmentation on Chinese social media. Previous work mainly focus on word segmentation for plain Chinese text, in order to develop a Chinese social media processing…
Chinese Word SegmentationSegmentation