An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition
Motivation: In biomedical research, chemical is an important class of entities, and chemical named entity recognition (NER) is an important task in the field of biomedical information extraction. However, most popular chemical NER methods are based on traditional machine learning and their performances are heavily dependent on the feature engineering. Moreover, these methods are sentence-level ones which have the tagging inconsistency problem. Results: In this paper, we propose a neural network approach, i.e. attention-based bidirectional Long Short-Term Memory with a conditional random field layer (Att-BiLSTM-CRF), to document- level chemical NER. The approach leverages document-level global information obtained by atten- tion mechanism to enforce tagging consistency across multiple instances of the same token in a document. It achieves better performances with little feature engineering than other state-of-the-art methods on the BioCreative IV chemical compound and drug name recognition (CHEMDNER) cor- pus and the BioCreative V chemical-disease relation (CDR) task corpus (the F-scores of 91.14 and 92.57%, respectively). Availability and implementation: Data and code are available at https://github.com/lingluodlut/Att- ChemdNER. Contact: yangzh@dlut.edu.cn or wangleibihami@gmail.com Supplementary information: Supplementary data are available at Bioinformatics online.
Code (1)
Tasks
Feature Engineeringnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSentenceSimilar Papers 제목 키워드 기반
Comparing CNN and LSTM character-level embeddings in BiLSTM-CRF models for chemical and disease named entity recognition
We compare the use of LSTM-based and CNN-based character-level word embeddings in BiLSTM-CRF models to approach chemical and disease named entity recognition (NER) tasks. Empirical results over the BioCreative V CDR corp…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1Improving Chemical Named Entity Recognition in Patents with Contextualized Word Embeddings
Chemical patents are an important resource for chemical information. However, few chemical Named Entity Recognition (NER) systems have been evaluated on patent documents, due in part to their structural and linguistic co…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1Hierarchical Contextualized Representation for Named Entity Recognition
Named entity recognition (NER) models are typically based on the architecture of Bi-directional LSTM (BiLSTM). The constraints of sequential nature and the modeling of single input prevent the full utilization of global …
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1ViBERTgrid BiLSTM-CRF: Multimodal Key Information Extraction from Unstructured Financial Documents
Multimodal key information extraction (KIE) models have been studied extensively on semi-structured documents. However, their investigation on unstructured documents is an emerging research topic. The paper presents an a…
Key Information Extractionnamed-entity-recognitionNamed Entity RecognitionA hybrid deep-learning approach for complex biochemical named entity recognition
Named entity recognition (NER) of chemicals and drugs is a critical domain of information extraction in biochemical research. NER provides support for text mining in biochemical reactions, including entity relation extra…
AttributeAttribute Extractionnamed-entity-recognitionNamed Entity Recognition+3