paper-with-me

홈 › Papers

Revealing Vulnerabilities of Neural Networks in Parameter Learning and Defense Against Explanation-Aware Backdoors

2024-03-25 · Md Abdul Kadir, GowthamKrishna Addluri, Daniel Sonntag

Explainable Artificial Intelligence (XAI) strategies play a crucial part in increasing the understanding and trustworthiness of neural networks. Nonetheless, these techniques could potentially generate misleading explanations. Blinding attacks can drastically alter a machine learning algorithm's prediction and explanation, providing misleading information by adding visually unnoticeable artifacts into the input, while maintaining the model's accuracy. It poses a serious challenge in ensuring the reliability of XAI methods. To ensure the reliability of XAI methods poses a real challenge, we leverage statistical analysis to highlight the changes in CNN weights within a CNN following blinding attacks. We introduce a method specifically designed to limit the effectiveness of such attacks during the evaluation phase, avoiding the need for extra training. The method we suggest defences against most modern explanation-aware adversarial attacks, achieving an approximate decrease of ~99\% in the Attack Success Rate (ASR) and a ~91\% reduction in the Mean Square Error (MSE) between the original explanation and the defended (post-attack) explanation across three unique types of attacks.

📄 PDF Abstract BibTeX arXiv:2403.16569

Code (0)

등록된 구현이 없습니다.

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Similar Papers 제목 키워드 기반

Can Large Language Models Find And Fix Vulnerable Software?

2023-08-20 · David Noever

In this study, we evaluated the capability of Large Language Models (LLMs), particularly OpenAI's GPT-4, in detecting software vulnerabilities, comparing their performance against traditional static code analyzers like S…

SpecWav-Attack: Leveraging Spectrogram Resizing and Wav2Vec 2.0 for Attacking Anonymized Speech

2025-01-10 · Yuqi Li, Yuanzhong Zheng, Zhongtian Guo, Yaoxuan Wang 외

This paper presents SpecWav-Attack, an adversarial model for detecting speakers in anonymized speech. It leverages Wav2Vec2 for feature extraction and incorporates spectrogram resizing and incremental training for improv…

Adversarial Attacks on VQA-NLE: Exposing and Alleviating Inconsistencies in Visual Question Answering Explanations

2025-08-17 · Yahsin Yeh, Yilun Wu, Bokai Ruan, Honghan Shuai arxiv

Natural language explanations in visual question answering (VQA-NLE) aim to make black-box models more transparent by elucidating their decision-making processes. However, we find that existing VQA-NLE systems can produc…

Visual Question Answering

A novel reliability attack of Physical Unclonable Functions

2024-05-21 · Gaoxiang Li, Yu Zhuang

Physical Unclonable Functions (PUFs) are emerging as promising security primitives for IoT devices, providing device fingerprints based on physical characteristics. Despite their strengths, PUFs are vulnerable to machine…

LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet

2024-08-27 · Nathaniel Li, Ziwen Han, Ian Steneker, Willow Primack 외

Recent large language model (LLM) defenses have greatly improved models' ability to refuse harmful queries, even when adversarially attacked. However, LLM defenses are primarily evaluated against automated adversarial at…

Language ModelingLanguage ModellingLarge Language ModelMachine Unlearning+1