Attacking Misinformation Detection Using Adversarial Examples Generated by Language Models
We investigate the challenge of generating adversarial examples to test the robustness of text classification algorithms detecting low-credibility content, including propaganda, false claims, rumours and hyperpartisan news. We focus on simulation of content moderation by setting realistic limits on the number of queries an attacker is allowed to attempt. Within our solution (TREPAT), initial rephrasings are generated by large language models with prompts inspired by meaning-preserving NLP tasks, e.g. text simplification and style transfer. Subsequently, these modifications are decomposed into small changes, applied through beam search procedure until the victim classifier changes its decision. The evaluation confirms the superiority of our approach in the constrained scenario, especially in case of long input text (news articles), where exhaustive search is not feasible.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesMisinformationRumour DetectionStyle Transfertext-classificationText ClassificationText SimplificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Robust Detection of Adversarial Examples
Although the recent progress is substantial, deep learning methods can be vulnerable to the maliciously generated adversarial examples. In this paper, we present a novel training procedure and a thresholding test strateg…
Category-wise Attack: Transferable Adversarial Examples for Anchor Free Object Detection
Deep neural networks have been demonstrated to be vulnerable to adversarial attacks: subtle perturbations can completely change the classification results. Their vulnerability has led to a surge of research in this direc…
Objectobject-detectionObject DetectionImperceptible Adversarial Examples for Fake Image Detection
Fooling people with highly realistic fake images generated with Deepfake or GANs brings a great social disturbance to our society. Many methods have been proposed to detect fake images, but they are vulnerable to adversa…
Face SwappingFake Image DetectionFast Local Attack: Generating Local Adversarial Examples for Object Detectors
The deep neural network is vulnerable to adversarial examples. Adding imperceptible adversarial perturbations to images is enough to make them fail. Most existing research focuses on attacking image classifiers or anchor…
ObjectRegional Homogeneity: Towards Learning Transferable Universal Adversarial Perturbations Against Defenses
This paper focuses on learning transferable adversarial examples specifically against defense models (models to defense adversarial attacks). In particular, we show that a simple universal perturbation can fool a series …
object-detectionObject DetectionSemantic Segmentation