Biomedical named entity recognition using BERT in the machine reading comprehension framework
Recognition of biomedical entities from literature is a challenging research focus, which is the foundation for extracting a large amount of biomedical knowledge existing in unstructured texts into structured formats. Using the sequence labeling framework to implement biomedical named entity recognition (BioNER) is currently a conventional method. This method, however, often cannot take full advantage of the semantic information in the dataset, and the performance is not always satisfactory. In this work, instead of treating the BioNER task as a sequence labeling problem, we formulate it as a machine reading comprehension (MRC) problem. This formulation can introduce more prior knowledge utilizing well-designed queries, and no longer need decoding processes such as conditional random fields (CRF). We conduct experiments on six BioNER datasets, and the experimental results demonstrate the effectiveness of our method. Our method achieves state-of-the-art (SOTA) performance on the BC4CHEMD, BC5CDR-Chem, BC5CDR-Disease, NCBI-Disease, BC2GM and JNLPBA datasets, achieving F1-scores of 92.92%, 94.19%, 87.83%, 90.04%, 85.48% and 78.93%, respectively.
Code (1)
Tasks
Machine Reading Comprehensionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Reading ComprehensionSimilar Papers 제목 키워드 기반
A Benchmark Evaluation of Clinical Named Entity Recognition in French
Background: Transformer-based language models have shown strong performance on many Natural LanguageProcessing (NLP) tasks. Masked Language Models (MLMs) attract sustained interest because they can be adaptedto different…
named-entity-recognitionNamed Entity RecognitionPartial Annotation Learning for Biomedical Entity Recognition
Motivation: Named Entity Recognition (NER) is a key task to support biomedical research. In Biomedical Named Entity Recognition (BioNER), obtaining high-quality expert annotated data is laborious and expensive, leading t…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERA Comparison between Named Entity Recognition Models in the Biomedical Domain
The domain-specialised application of Named Entity Recognition (NER) is known as Biomedical NER (BioNER), which aims to identify and classify biomedical concepts that are of interest to researchers, such as genes, protei…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1Biomedical Named Entity Recognition with Multilingual BERT
We present the approach of the Turku NLP group to the PharmaCoNER task on Spanish biomedical named entity recognition. We apply a CRF-based baseline approach and multilingual BERT to the task, achieving an F-score of 88{…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition
In recent years, with the growing amount of biomedical documents, coupled with advancement in natural language processing algorithms, the research on biomedical named entity recognition (BioNER) has increased exponential…
Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+3