Transfer Deep Learning for Low-Resource Chinese Word Segmentation with a Novel Neural Network

2017-02-15 · Jingjing Xu, Xu sun

Recent studies have shown effectiveness in using neural networks for Chinese word segmentation. However, these models rely on large-scale data and are less effective for low-resource datasets because of insufficient training data. We propose a transfer learning method to improve low-resource word segmentation by leveraging high-resource corpora. First, we train a teacher model on high-resource corpora and then use the learned knowledge to initialize a student model. Second, a weighted data similarity method is proposed to train the student model on low-resource data. Experiment results show that our work significantly improves the performance on low-resource datasets: 2.3% and 1.5% F-score on PKU and CTB datasets. Furthermore, this paper achieves state-of-the-art results: 96.1%, and 96.2% F-score on PKU and CTB datasets.

📄 PDF Abstract BibTeX arXiv:1702.04488

Code (0)

등록된 구현이 없습니다.

Tasks

Chinese Word Segmentation Segmentation Transfer Learning

Adaptive Multi-Task Transfer Learning for Chinese Word Segmentation in Medical Text

2018-08-01 · COLING 2018 8 · Junjie Xing, Kenny Zhu, Shaodian Zhang

Chinese word segmentation (CWS) trained from open source corpus faces dramatic performance drop when dealing with domain text, especially for a domain with lots of special terms and diverse writing styles, such as the bi…

Chinese Word Segmentation Transfer Learning

Approaching Neural Chinese Word Segmentation as a Low-Resource Machine Translation Task

2020-08-12 · Pin-zhen Chen, Kenneth Heafield

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplifi…

Chinese Word Segmentation Low Resource Neural Machine Translation Low-Resource Neural Machine Translation Machine Translation+2

Deep Stacking Networks for Low-Resource Chinese Word Segmentation with Transfer Learning

2017-11-04 · Jingjing Xu, Xu sun, Sujian Li, Xiaoyan Cai 외

In recent years, neural networks have proven to be effective in Chinese word segmentation. However, this promising performance relies on large-scale training data. Neural networks with conventional architectures cannot a…

Chinese Word Segmentation Transfer Learning

BERT 4EVER@EvaHan 2022: Ancient Chinese Word Segmentation and Part-of-Speech Tagging Based on Adversarial Learning and Continual Pre-training

2022-06-01 · LT4HALA (LREC) 2022 6 · Hailin Zhang, Ziyu Yang, Yingwen Fu, Ruoyao Ding

With the development of artificial intelligence (AI) and digital humanities, ancient Chinese resources and language technology have also developed and grown, which have become an increasingly important part to the study …

Chinese Word Segmentation Cultural Vocal Bursts Intensity Prediction Ensemble Learning Part-Of-Speech Tagging+3

Overview of the NLPCC 2015 Shared Task: Chinese Word Segmentation and POS Tagging for Micro-blog Texts

2015-05-28 · Xipeng Qiu, Peng Qian, Liusong Yin, Shiyu Wu 외

In this paper, we give an overview for the shared task at the 4th CCF Conference on Natural Language Processing \& Chinese Computing (NLPCC 2015): Chinese word segmentation and part-of-speech (POS) tagging for micro-blog…

Chinese Word Segmentation Part-Of-Speech Tagging POS POS Tagging+1