Named Entity Recognition Only from Word Embeddings
Deep neural network models have helped named entity (NE) recognition achieve amazing performance without handcrafting features. However, existing systems require large amounts of human annotated training data. Efforts have been made to replace human annotations with external knowledge (e.g., NE dictionary, part-of-speech tags), while it is another challenge to obtain such effective resources. In this work, we propose a fully unsupervised NE recognition model which only needs to take informative clues from pre-trained word embeddings. We first apply Gaussian Hidden Markov Model and Deep Autoencoding Gaussian Mixture Model on word embeddings for entity span detection and type prediction, and then further design an instance selector based on reinforcement learning to distinguish positive sentences from noisy sentences and refine these coarse-grained annotations through neural networks. Extensive experiments on CoNLL benchmark datasets demonstrate that our proposed light NE recognition model achieves remarkable performance without using any annotated lexicon or corpus.
Code (0)
등록된 구현이 없습니다.
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Reinforcement LearningType predictionWord EmbeddingsSimilar Papers 제목 키워드 기반
A Morpho-Syntactically Informed LSTM-CRF Model for Named Entity Recognition
We propose a morphologically informed model for named entity recognition, which is based on LSTM-CRF architecture and combines word embeddings, Bi-LSTM character embeddings, part-of-speech (POS) tags, and morphological i…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2A Multi-task Learning Approach to Adapting Bilingual Word Embeddings for Cross-lingual Named Entity Recognition
We show how to adapt bilingual word embeddings (BWE{'}s) to bootstrap a cross-lingual name-entity recognition (NER) system in a language with no labeled data. We assume a setting where we are given a comparable corpus wi…
Cross-Lingual TransferMulti-Task Learningnamed-entity-recognitionNamed Entity Recognition+3Morphological Embeddings for Named Entity Recognition in Morphologically Rich Languages
In this work, we present new state-of-the-art results of 93.59,% and 79.59,% for Turkish and Czech named entity recognition based on the model of (Lample et al., 2016). We contribute by proposing several schemes for repr…
Morphological Analysisnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Lexicon Infused Phrase Embeddings for Named Entity Resolution
Most state-of-the-art approaches for named-entity recognition (NER) use semi supervised information in the form of word clusters and lexicons. Recently neural network-based language models have been explored, as they as …
Entity ResolutionFormLearning Word Embeddingsnamed-entity-recognition+4Hierarchical Meta-Embeddings for Code-Switching Named Entity Recognition
In countries that speak multiple main languages, mixing up different languages within a conversation is commonly called code-switching. Previous works addressing this challenge mainly focused on word-level aspects such a…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Word Embeddings