paper-with-me

Papers

PFAttack: Stealthy Attack Bypassing Group Fairness in Federated Learning

2024-10-09 · Jiashi Gao, Ziwei Wang, Xiangyu Zhao, Xin Yao, Xuetao Wei

Federated learning (FL), integrating group fairness mechanisms, allows multiple clients to collaboratively train a global model that makes unbiased decisions for different populations grouped by sensitive attributes (e.g., gender and race). Due to its distributed nature, previous studies have demonstrated that FL systems are vulnerable to model poisoning attacks. However, these studies primarily focus on perturbing accuracy, leaving a critical question unexplored: Can an attacker bypass the group fairness mechanisms in FL and manipulate the global model to be biased? The motivations for such an attack vary; an attacker might seek higher accuracy, yet fairness considerations typically limit the accuracy of the global model or aim to cause ethical disruption. To address this question, we design a novel form of attack in FL, termed Profit-driven Fairness Attack (PFATTACK), which aims not to degrade global model accuracy but to bypass fairness mechanisms. Our fundamental insight is that group fairness seeks to weaken the dependence of outputs on input attributes related to sensitive information. In the proposed PFATTACK, an attacker can recover this dependence through local fine-tuning across various sensitive groups, thereby creating a biased yet accuracy-preserving malicious model and injecting it into FL through model replacement. Compared to attacks targeting accuracy, PFATTACK is more stealthy. The malicious model in PFATTACK exhibits subtle parameter variations relative to the original global model, making it robust against detection and filtering by Byzantine-resilient aggregations. Extensive experiments on benchmark datasets are conducted for four fair FL frameworks and three Byzantine-resilient aggregations against model poisoning, demonstrating the effectiveness and stealth of PFATTACK in bypassing group fairness mechanisms in FL.

📄 PDF Abstract BibTeX arXiv:2410.06509

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessFederated LearningModel Poisoning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

BadFair: Backdoored Fairness Attacks with Group-conditioned Triggers

2024-10-23 · Jiaqi Xue, Qian Lou, Mengxin Zheng

Attacking fairness is crucial because compromised models can introduce biased outcomes, undermining trust and amplifying inequalities in sensitive applications like hiring, healthcare, and law enforcement. This highlight…

Fairness

TrojFair: Trojan Fairness Attacks

2023-12-16 · Mengxin Zheng, Jiaqi Xue, Yi Sheng, Lei Yang 외

Deep learning models have been incorporated into high-stakes sectors, including healthcare diagnosis, loan approvals, and candidate recruitment, among others. Consequently, any bias or unfairness in these models can harm…

Deep LearningFairness

Disabling Self-Correction in Retrieval-Augmented Generation via Stealthy Retriever Poisoning

2025-08-27 · Yanbo Dai, Zhenlan Ji, Zongjie Li, Kuan Li 외 arxiv

Retrieval-Augmented Generation (RAG) has become a standard approach for improving the reliability of large language models (LLMs). Prior work demonstrates the vulnerability of RAG systems by misleading them into generati…

When Safety Detectors Aren't Enough: A Stealthy and Effective Jailbreak Attack on LLMs via Steganographic Techniques

2025-05-22 · Jianing Geng, Biao Yi, Zekun Fei, Tongxi Wu 외

Jailbreak attacks pose a serious threat to large language models (LLMs) by bypassing built-in safety mechanisms and leading to harmful outputs. Studying these attacks is crucial for identifying vulnerabilities and improv…

Benchmarking

LIRA: Learnable, Imperceptible and Robust Backdoor Attacks

2021-01-01 · ICCV 2021 10 · Khoa Doan, Yingjie Lao, Weijie Zhao, Ping Li

Recently, machine learning models have demonstrated to be vulnerable to backdoor attacks, primarily due to the lack of transparency in black-box models such as deep neural networks. A third-party model can be poisone…

Backdoor Attackbackdoor defenseStochastic Optimization