SeqAttack: On Adversarial Attacks for Named Entity Recognition
Named Entity Recognition is a fundamental task in information extraction and is an essential element for various Natural Language Processing pipelines. Adversarial attacks have been shown to greatly affect the performance of text classification systems but knowledge about their effectiveness against named entity recognition models is limited. This paper investigates the effectiveness and portability of adversarial attacks from text classification to named entity recognition and the ability of adversarial training to counteract these attacks. We find that character-level and word-level attacks are the most effective, but adversarial training can grant significant protection at little to no expense of standard performance. Alongside our results, we also release SeqAttack, a framework to conduct adversarial attacks against token classification models (used in this work for named entity recognition) and a companion web application to inspect and cherry pick adversarial examples.
Code (0)
등록된 구현이 없습니다.
Tasks
Classificationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)text-classificationText Classificationtoken-classificationToken ClassificationSimilar Papers 제목 키워드 기반
Resilience of Named Entity Recognition Models under Adversarial Attack
Named entity recognition (NER) is a popular language processing task with wide applications. Progress in NER has been noteworthy, as evidenced by the F1 scores obtained on standard datasets. In practice, however, the end…
Adversarial Attacknamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Robust Few-Shot Named Entity Recognition with Boundary Discrimination and Correlation Purification
Few-shot named entity recognition (NER) aims to recognize novel named entities in low-resource domains utilizing existing knowledge. However, the present few-shot NER models assume that the labeled data are all clean wit…
Adversarial AttackEntity Typingfew-shot-nerFew-shot NER+5Context-aware Adversarial Attack on Named Entity Recognition
In recent years, large pre-trained language models (PLMs) have achieved remarkable performance on many natural language processing benchmarks. Despite their success, prior studies have shown that PLMs are vulnerable to a…
Adversarial Attacknamed-entity-recognitionNamed Entity RecognitionLeveraging Expert Guided Adversarial Augmentation For Improving Generalization in Named Entity Recognition
Named Entity Recognition (NER) systems often demonstrate great performance on in-distribution data, but perform poorly on examples drawn from a shifted distribution. One way to evaluate the generalization ability of NER …
Domain Generalizationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Attack Named Entity Recognition by Entity Boundary Interference
Named Entity Recognition (NER) is a cornerstone NLP task while its robustness has been given little attention. This paper rethinks the principles of NER attacks derived from sentence classification, as they can easily vi…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2