paper-with-me

Papers

Enhancing Adversarial Text Attacks on BERT Models with Projected Gradient Descent

2024-07-29 · Hetvi Waghela, Jaydip Sen, Sneha Rakshit

Adversarial attacks against deep learning models represent a major threat to the security and reliability of natural language processing (NLP) systems. In this paper, we propose a modification to the BERT-Attack framework, integrating Projected Gradient Descent (PGD) to enhance its effectiveness and robustness. The original BERT-Attack, designed for generating adversarial examples against BERT-based models, suffers from limitations such as a fixed perturbation budget and a lack of consideration for semantic similarity. The proposed approach in this work, PGD-BERT-Attack, addresses these limitations by leveraging PGD to iteratively generate adversarial examples while ensuring both imperceptibility and semantic similarity to the original input. Extensive experiments are conducted to evaluate the performance of PGD-BERT-Attack compared to the original BERT-Attack and other baseline methods. The results demonstrate that PGD-BERT-Attack achieves higher success rates in causing misclassification while maintaining low perceptual changes. Furthermore, PGD-BERT-Attack produces adversarial instances that exhibit greater semantic resemblance to the initial input, enhancing their applicability in real-world scenarios. Overall, the proposed modification offers a more effective and robust approach to adversarial attacks on BERT-based models, thus contributing to the advancement of defense against attacks on NLP systems.

📄 PDF Abstract BibTeX arXiv:2407.21073

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial TextSemantic SimilaritySemantic Textual Similarity

Similar Papers 제목 키워드 기반

Bridge the Gap Between CV and NLP! A Gradient-based Textual Adversarial Attack Framework

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Despite the success of recent deep learning techniques, they still perform poorly on adversarial examples with small perturbations. While gradient-based adversarial attack methods are well-explored in the field of comput…

Adversarial AttackLanguage ModelingLanguage Modelling

Guided Adversarial Attack for Evaluating and Enhancing Adversarial Defenses

2020-11-30 · NeurIPS 2020 12 · Gaurang Sriramanan, Sravanti Addepalli, Arya Baburaj, R. Venkatesh Babu

Advances in the development of adversarial attacks have been fundamental to the progress of adversarial defense research. Efficient and effective attacks are crucial for reliable evaluation of defenses, and also for deve…

Adversarial AttackAdversarial Defense

Arabic Synonym BERT-based Adversarial Examples for Text Classification

2024-02-05 · Norah Alshahrani, Saied Alshahrani, Esma Wali, Jeanna Matthews

Text classification systems have been proven vulnerable to adversarial text examples, modified versions of the original text examples that are often unnoticed by human eyes, yet can force text classification models to al…

Adversarial TextLanguage ModelingLanguage ModellingMasked Language Modeling+2

SemRoDe: Macro Adversarial Training to Learn Representations That are Robust to Word-Level Attacks

2024-03-27 · Brian Formento, Wenjie Feng, Chuan Sheng Foo, Luu Anh Tuan 외

Language models (LMs) are indispensable tools for natural language processing tasks, but their vulnerability to adversarial attacks remains a concern. While current research has explored adversarial training techniques, …

Word Embeddings

IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Method

2025-05-11 · Mihyeon Kim, Juhyoung Park, Youngbin Kim

Pre-trained Language Models (PLMs) have achieved remarkable performance on diverse NLP tasks through pre-training and fine-tuning. However, fine-tuning the model with a large number of parameters on limited downstream da…