Neural Regularized Domain Adaptation for Chinese Word Segmentation

2017-12-01 · WS 2017 12 · Zuyi Bao, Si Li, Weiran Xu, Sheng Gao

For Chinese word segmentation, the large-scale annotated corpora mainly focus on newswire and only a handful of annotated data is available in other domains such as patents and literature. Considering the limited amount of annotated target domain data, it is a challenge for segmenters to learn domain-specific information while avoid getting over-fitted at the same time. In this paper, we propose a neural regularized domain adaptation method for Chinese word segmentation. The teacher networks trained in source domain are employed to regularize the training process of the student network by preserving the general knowledge. In the experiments, our neural regularized domain adaptation method achieves a better performance comparing to previous methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Chinese Word Segmentation Domain Adaptation General Knowledge Model Compression Segmentation

Using a Goodness Measurement for Domain Adaptation: A Case Study on Chinese Word Segmentation

2012-05-01 · LREC 2012 5 · Yan Song, Fei Xia

Domain adaptation is an important topic for natural language processing. There has been extensive research on the topic and various methods have been explored, including training data selection, model combination, semi-s…

Chinese Word Segmentation Domain Adaptation Segmentation

Addressing Domain Adaptation for Chinese Word Segmentation with Global Recurrent Structure

2017-11-01 · IJCNLP 2017 11 · Shen Huang, Xu sun, Houfeng Wang

Boundary features are widely used in traditional Chinese Word Segmentation (CWS) methods as they can utilize unlabeled data to help improve the Out-of-Vocabulary (OOV) word recognition performance. Although various neura…

Articles Chinese Word Segmentation Domain Adaptation Feature Engineering+1

Domain Adaptation for CRF-based Chinese Word Segmentation using Free Annotations

2014-10-01 · EMNLP 2014 10 · Yijia Liu, Yue Zhang, Wanxiang Che, Ting Liu 외

Chinese Word Segmentation Domain Adaptation Information Retrieval

PKUSEG: A Toolkit for Multi-Domain Chinese Word Segmentation

2019-06-27 · Ruixuan Luo, Jingjing Xu, Yi Zhang, Zhiyuan Zhang 외

Chinese word segmentation (CWS) is a fundamental step of Chinese natural language processing. In this paper, we build a new toolkit, named PKUSEG, for multi-domain word segmentation. Unlike existing single-model toolkits…

Chinese Word Segmentation Domain Adaptation POS POS Tagging+1

Towards Accurate Word Segmentation for Chinese Patents

2016-11-30 · Si Li, Nianwen Xue

A patent is a property right for an invention granted by the government to the inventor. An invention is a solution to a specific technological problem. So patents often have a high concentration of scientific and techni…

Chinese Word Segmentation Domain Adaptation