Improving Named Entity Recognition for Chinese Social Media with Word Segmentation Representation Learning
Named entity recognition, and other information extraction tasks, frequently use linguistic features such as part of speech tags or chunkings. For languages where word boundaries are not readily identified in text, word segmentation is a key first step to generating features for an NER system. While using word boundary tags as features are helpful, the signals that aid in identifying these boundaries may provide richer information for an NER system. New state-of-the-art word segmentation systems use neural models to learn representations for predicting word boundaries. We show that these same representations, jointly trained with an NER system, yield significant improvements in NER for Chinese social media. In our experiments, jointly training NER and word segmentation with an LSTM-CRF model yields nearly 5% absolute improvement over previously published results.
Code (0)
등록된 구현이 없습니다.
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERRepresentation LearningSegmentationSimilar Papers 제목 키워드 기반
Integrating Boundary Assembling into a DNN Framework for Named Entity Recognition in Chinese Social Media Text
Named entity recognition is a challenging task in Natural Language Processing, especially for informal and noisy social media text. Chinese word boundaries are also entity boundaries, therefore, named entity recognition …
Boundary DetectionChinese Word Segmentationnamed-entity-recognitionNamed Entity Recognition+2Named Entity Recognition for Chinese Social Media with Jointly Trained Embeddings
F-Score Driven Max Margin Neural Network for Named Entity Recognition in Chinese Social Media
We focus on named entity recognition (NER) for Chinese social media. With massive unlabeled text and quite limited labelled corpus, we propose a semi-supervised learning model based on B-LSTM neural network. To take adva…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERNamed Entity Recognition for Social Media Texts with Semantic Augmentation
Existing approaches for named entity recognition suffer from data sparsity problems when conducted on short and informal texts, especially user-generated social media content. Semantic augmentation is a potential way to …
Chinese Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2Improving Chinese Named Entity Recognition by Search Engine Augmentation
Compared with English, Chinese suffers from more grammatical ambiguities, like fuzzy word boundaries and polysemous words. In this case, contextual information is not sufficient to support Chinese named entity recognitio…
Chinese Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1