Resilience of Named Entity Recognition Models under Adversarial Attack
Named entity recognition (NER) is a popular language processing task with wide applications. Progress in NER has been noteworthy, as evidenced by the F1 scores obtained on standard datasets. In practice, however, the end-user uses an NER model on their dataset out-of-the-box, on text that may not be pristine. In this paper we present four model-agnostic adversarial attacks to gauge the resilience of NER models in such scenarios. Our experiments on four state-of-the-art NER methods with five English datasets suggest that the NER models are over-reliant on case information and do not utilise contextual information well. As such, they are highly susceptible to adversarial attacks based on these features.
Code (1)
Tasks
Adversarial Attacknamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSimilar Papers 제목 키워드 기반
SeqAttack: On Adversarial Attacks for Named Entity Recognition
Named Entity Recognition is a fundamental task in information extraction and is an essential element for various Natural Language Processing pipelines. Adversarial attacks have been shown to greatly affect the performanc…
Classificationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+4Transformer-Based Named Entity Recognition for Automated Server Provisioning
This paper introduces a novel method for automated server provisioning by integrating Transformerbased Named Entity Recognition models with Automated Speech Detection using OpenAI's Whisper. Leveraging advanced Transform…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+3Robust Few-Shot Named Entity Recognition with Boundary Discrimination and Correlation Purification
Few-shot named entity recognition (NER) aims to recognize novel named entities in low-resource domains utilizing existing knowledge. However, the present few-shot NER models assume that the labeled data are all clean wit…
Adversarial AttackEntity Typingfew-shot-nerFew-shot NER+5Leveraging Expert Guided Adversarial Augmentation For Improving Generalization in Named Entity Recognition
Named Entity Recognition (NER) systems often demonstrate great performance on in-distribution data, but perform poorly on examples drawn from a shifted distribution. One way to evaluate the generalization ability of NER …
Domain Generalizationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Context-aware Adversarial Attack on Named Entity Recognition
In recent years, large pre-trained language models (PLMs) have achieved remarkable performance on many natural language processing benchmarks. Despite their success, prior studies have shown that PLMs are vulnerable to a…
Adversarial Attacknamed-entity-recognitionNamed Entity Recognition