paper-with-me

홈 › Papers

Biomedical Named Entity Recognition at Scale

2020-11-12 · Veysel Kocaman, David Talby

Named entity recognition (NER) is a widely applicable natural language processing task and building block of question answering, topic modeling, information retrieval, etc. In the medical domain, NER plays a crucial role by extracting meaningful chunks from clinical notes and reports, which are then fed to downstream tasks like assertion status detection, entity resolution, relation extraction, and de-identification. Reimplementing a Bi-LSTM-CNN-Char deep learning architecture on top of Apache Spark, we present a single trainable NER model that obtains new state-of-the-art results on seven public biomedical benchmarks without using heavy contextual embeddings like BERT. This includes improving BC4CHEMD to 93.72% (4.1% gain), Species800 to 80.91% (4.6% gain), and JNLPBA to 81.29% (5.2% gain). In addition, this model is freely available within a production-grade code base as part of the open-source Spark NLP library; can scale up for training and inference in any Spark cluster; has GPU support and libraries for popular programming languages such as Python, R, Scala and Java; and can be extended to support other human languages with no code changes.

📄 PDF Abstract BibTeX arXiv:2011.06315

Code (1)

JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/Certification_Trainings/Healthcare/1.4.Biomedical_NER_SparkNLP_paper_reproduce.ipynb 공식 구현

Tasks

De-identificationEntity ResolutionGPUInformation RetrievalMedical Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERQuestion AnsweringRelation ExtractionRetrieval

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
WordPiece 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention 설명 없음
Adam 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Similar Papers 제목 키워드 기반

BERN2: an advanced neural biomedical named entity recognition and normalization tool

2022-01-06 · Mujeen Sung, Minbyul Jeong, Yonghwa Choi, Donghyeon Kim 외

In biomedical natural language processing, named entity recognition (NER) and named entity normalization (NEN) are key tasks that enable the automatic extraction of biomedical entities (e.g. diseases and drugs) from the …

graph constructionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1

Accurate clinical and biomedical Named entity recognition at scale

2022-07-19 · Software Impacts 2022 7 · Kocaman, Veysel; Talby, David

We introduce an agile, production-grade clinical and biomedical Named entity recognition (NER) algorithm based on a modified BiLSTM-CNN-Char DL architecture built on top of Apache Spark. Our NER implementation establishe…

Clinical Concept ExtractionDe-identificationnamed-entity-recognitionNamed Entity Recognition+2

In-domain Context-aware Token Embeddings Improve Biomedical Named Entity Recognition

2018-10-01 · WS 2018 10 · Golnar Sheikhshabbafghi, Inanc Birol, Anoop Sarkar

Rapidly expanding volume of publications in the biomedical domain makes it increasingly difficult for a timely evaluation of the latest literature. That, along with a push for automated evaluation of clinical reports, pr…

Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+5

Analyzing the Effect of Multi-task Learning for Biomedical Named Entity Recognition

2020-11-01 · Arda Akdemir, Tetsuo Shibuya

Developing high-performing systems for detecting biomedical named entities has major implications. State-of-the-art deep-learning based solutions for entity recognition often require large annotated datasets, which is no…

Multi-Task Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1

Biomedical and Clinical English Model Packages in the Stanza Python NLP Library

2020-07-29 · Yuhao Zhang, Yuhui Zhang, Peng Qi, Christopher D. Manning 외

We introduce biomedical and clinical English model packages for the Stanza Python NLP library. These packages offer accurate syntactic analysis and named entity recognition capabilities for biomedical and clinical text, …

GPUNamed Entity RecognitionNamed Entity Recognition (NER)