Biomedical Named Entity Recognition at Scale
Named entity recognition (NER) is a widely applicable natural language processing task and building block of question answering, topic modeling, information retrieval, etc. In the medical domain, NER plays a crucial role by extracting meaningful chunks from clinical notes and reports, which are then fed to downstream tasks like assertion status detection, entity resolution, relation extraction, and de-identification. Reimplementing a Bi-LSTM-CNN-Char deep learning architecture on top of Apache Spark, we present a single trainable NER model that obtains new state-of-the-art results on seven public biomedical benchmarks without using heavy contextual embeddings like BERT. This includes improving BC4CHEMD to 93.72% (4.1% gain), Species800 to 80.91% (4.6% gain), and JNLPBA to 81.29% (5.2% gain). In addition, this model is freely available within a production-grade code base as part of the open-source Spark NLP library; can scale up for training and inference in any Spark cluster; has GPU support and libraries for popular programming languages such as Python, R, Scala and Java; and can be extended to support other human languages with no code changes.
Code (1)
Tasks
De-identificationEntity ResolutionGPUInformation RetrievalMedical Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERQuestion AnsweringRelation ExtractionRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BERN2: an advanced neural biomedical named entity recognition and normalization tool
In biomedical natural language processing, named entity recognition (NER) and named entity normalization (NEN) are key tasks that enable the automatic extraction of biomedical entities (e.g. diseases and drugs) from the …
graph constructionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Accurate clinical and biomedical Named entity recognition at scale
We introduce an agile, production-grade clinical and biomedical Named entity recognition (NER) algorithm based on a modified BiLSTM-CNN-Char DL architecture built on top of Apache Spark. Our NER implementation establishe…
Clinical Concept ExtractionDe-identificationnamed-entity-recognitionNamed Entity Recognition+2In-domain Context-aware Token Embeddings Improve Biomedical Named Entity Recognition
Rapidly expanding volume of publications in the biomedical domain makes it increasingly difficult for a timely evaluation of the latest literature. That, along with a push for automated evaluation of clinical reports, pr…
Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+5Analyzing the Effect of Multi-task Learning for Biomedical Named Entity Recognition
Developing high-performing systems for detecting biomedical named entities has major implications. State-of-the-art deep-learning based solutions for entity recognition often require large annotated datasets, which is no…
Multi-Task Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Biomedical and Clinical English Model Packages in the Stanza Python NLP Library
We introduce biomedical and clinical English model packages for the Stanza Python NLP library. These packages offer accurate syntactic analysis and named entity recognition capabilities for biomedical and clinical text, …
GPUNamed Entity RecognitionNamed Entity Recognition (NER)