Adversarial Evaluation of BERT for Biomedical Named Entity Recognition
The success of pre-trained word embeddings of the BERT model has motivated its use in tasks in the biomedical domain. However, it is not clear if this model works correctly in real scenarios. In this work, we propose an adversarial evaluation scheme in a BioNER dataset, which consists of two types of attacks inspired by natural spelling errors and synonyms of medical terms. Our results indicate that under these adversarial settings, the performance of the models drops significantly. Despite the result, we show how the robustness of the models can be significantly improved by training them with adversarial examples.
Code (0)
등록된 구현이 없습니다.
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Word EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Benchmark Evaluation of Clinical Named Entity Recognition in French
Background: Transformer-based language models have shown strong performance on many Natural LanguageProcessing (NLP) tasks. Masked Language Models (MLMs) attract sustained interest because they can be adaptedto different…
named-entity-recognitionNamed Entity RecognitionCamemBERT-bio: Leveraging Continual Pre-training for Cost-Effective Models on French Biomedical Data
Clinical data in hospitals are increasingly accessible for research through clinical data warehouses. However these documents are unstructured and it is therefore necessary to extract information from medical reports to …
Language Modellingnamed-entity-recognitionNamed Entity RecognitionTransfer LearningA Comparison between Named Entity Recognition Models in the Biomedical Domain
The domain-specialised application of Named Entity Recognition (NER) is known as Biomedical NER (BioNER), which aims to identify and classify biomedical concepts that are of interest to researchers, such as genes, protei…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1Transfer Learning in Biomedical Named Entity Recognition: An Evaluation of BERT in the PharmaCoNER task
To date, a large amount of biomedical content has been published in non-English texts, especially for clinical documents. Therefore, it is of considerable significance to conduct Natural Language Processing (NLP) researc…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1Partial Annotation Learning for Biomedical Entity Recognition
Motivation: Named Entity Recognition (NER) is a key task to support biomedical research. In Biomedical Named Entity Recognition (BioNER), obtaining high-quality expert annotated data is laborious and expensive, leading t…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER