paper-with-me

홈 › Papers

An Encoding Strategy Based Word-Character LSTM for Chinese NER

2019-06-01 · NAACL 2019 6 · Wei Liu, Tongge Xu, Qinghua Xu, Jiayu Song, Yueran Zu

A recently proposed lattice model has demonstrated that words in character sequence can provide rich word boundary information for character-based Chinese NER model. In this model, word information is integrated into a shortcut path between the start and the end characters of the word. However, the existence of shortcut path may cause the model to degenerate into a partial word-based model, which will suffer from word segmentation errors. Furthermore, the lattice model can not be trained in batches due to its DAG structure. In this paper, we propose a novel word-character LSTM(WC-LSTM) model to add word information into the start or the end character of the word, alleviating the influence of word segmentation errors while obtaining the word boundary information. Four different strategies are explored in our model to encode word information into a fixed-sized representation for efficient batch training. Experiments on benchmark datasets show that our proposed model outperforms other state-of-the-arts models.

📄 PDF Abstract BibTeX

Code (1)

liuwei1206/CCW-NER 공식 구현 pytorch

Tasks

NERSegmentation

Similar Papers 제목 키워드 기반

Subword Encoding in Lattice LSTM for Chinese Word Segmentation

2018-10-30 · NAACL 2019 6 · Jie Yang, Yue Zhang, Shuailong Liang

We investigate a lattice LSTM network for Chinese word segmentation (CWS) to utilize words or subwords. It integrates the character sequence features with all subsequences information matched from a lexicon. The matched …

Chinese Word SegmentationWord Embeddings

Chinese NER Using Lattice LSTM

2018-05-05 · ACL 2018 7 · Yue Zhang, Jie Yang

We investigate a lattice-structured LSTM model for Chinese NER, which encodes a sequence of input characters as well as all potential words that match a lexicon. Compared with character-based methods, our model explicitl…

Chinese Named Entity RecognitionNERSentence

Chinese Spelling Error Detection Using a Fusion Lattice LSTM

2019-11-25 · Hao Wang, Bing Wang, Jianyong Duan, Jiajun Zhang

Spelling error detection serves as a crucial preprocessing in many natural language processing applications. Due to the characteristics of Chinese Language, Chinese spelling error detection is more challenging than error…

A Seq-to-Seq Transformer Premised Temporal Convolutional Network for Chinese Word Segmentation

2019-05-21 · Wei Jiang, Yan Tang

The prevalent approaches of Chinese word segmentation task almost rely on the Bi-LSTM neural network. However, the methods based the Bi-LSTM have some inherent drawbacks: hard to parallel computing, little efficient in a…

Chinese Word SegmentationDecoderSegmentationSentence

Which Encoding is the Best for Text Classification in Chinese, English, Japanese and Korean?

2017-08-08 · Xiang Zhang, Yann Lecun

This article offers an empirical study on the different ways of encoding Chinese, Japanese, Korean (CJK) and English languages for text classification. Different encoding levels are studied, including UTF-8 bytes, charac…

General ClassificationText Classification