paper-with-me

홈 › Papers

TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP

2020-04-29 · EMNLP 2020 11 · John X. Morris, Eli Lifland, Jin Yong Yoo, Jake Grigsby, Di Jin, Yanjun Qi

While there has been substantial research using adversarial attacks to analyze NLP models, each attack is implemented in its own code repository. It remains challenging to develop NLP attacks and utilize them to improve model performance. This paper introduces TextAttack, a Python framework for adversarial attacks, data augmentation, and adversarial training in NLP. TextAttack builds attacks from four components: a goal function, a set of constraints, a transformation, and a search method. TextAttack's modular design enables researchers to easily construct attacks from combinations of novel and existing components. TextAttack provides implementations of 16 adversarial attacks from the literature and supports a variety of models and datasets, including BERT and other transformers, and all GLUE tasks. TextAttack also includes data augmentation and adversarial training modules for using components of adversarial attacks to improve model accuracy and robustness. TextAttack is democratizing NLP: anyone can try data augmentation and adversarial training on any model or dataset, with just a few lines of code. Code and tutorials are available at https://github.com/QData/TextAttack.

📄 PDF Abstract BibTeX arXiv:2005.05909

Code (2)

QData/TextAttack 공식 구현 tf
QData/deepWordBug pytorch

Tasks

Adversarial AttackAdversarial TextData AugmentationLexical EntailmentMachine TranslationText Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Adam 설명 없음
Multi-Head Attention 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

TextAttack: Lessons learned in designing Python frameworks for NLP

2020-11-01 · EMNLP (NLPOSS) 2020 11 · John Morris, Jin Yong Yoo, Yanjun Qi

TextAttack is an open-source Python toolkit for adversarial attacks, adversarial training, and data augmentation in NLP. TextAttack unites 15+ papers from the NLP adversarial attack literature into a single framework, wi…

Adversarial AttackData Augmentation

Don’t Search for a Search Method — Simple Heuristics Suffice for Adversarial Text Attacks

2021-11-01 · EMNLP 2021 11 · Nathaniel Berger, Stefan Riezler, Sebastian Ebert, Artem Sokolov

Recently more attention has been given to adversarial attacks on neural networks for natural language processing (NLP). A central research topic has been the investigation of search algorithms and search constraints, acc…

Adversarial Text

Don't Search for a Search Method -- Simple Heuristics Suffice for Adversarial Text Attacks

2021-09-16 · Nathaniel Berger, Stefan Riezler, Artem Sokolov, Sebastian Ebert

Recently more attention has been given to adversarial attacks on neural networks for natural language processing (NLP). A central research topic has been the investigation of search algorithms and search constraints, acc…

Adversarial Text

Selective Adversarial Attacks on LLM Benchmarks

2025-10-15 · Ivan Dubrovsky, Anastasia Orlova, Illarion Iov, Nina Gubina 외 arxiv

Benchmarking outcomes increasingly govern trust, selection, and deployment of LLMs, yet these evaluations remain vulnerable to semantically equivalent adversarial perturbations. Prior work on adversarial robustness in NL…

Adversarial RobustnessGeneral Knowledge

Identifying Adversarial Attacks on Text Classifiers

2022-01-21 · Zhouhang Xie, Jonathan Brophy, Adam Noack, Wencong You 외

The landscape of adversarial attacks against text classifiers continues to grow, with new attacks developed every year and many of them available in standard toolkits, such as TextAttack and OpenAttack. In response, ther…

Abuse DetectionAdversarial TextLanguage ModellingSentiment Analysis