paper-with-me

Papers

Securing Federated Learning against Backdoor Threats with Foundation Model Integration

2024-10-23 · Xiaohuan Bi, Xi Li

Federated Learning (FL) enables decentralized model training while preserving privacy. Recently, the integration of Foundation Models (FMs) into FL has enhanced performance but introduced a novel backdoor attack mechanism. Attackers can exploit FM vulnerabilities to embed backdoors into synthetic data generated by FMs. During global model fusion, these backdoors are transferred to the global model through compromised synthetic data, subsequently infecting all client models. Existing FL backdoor defenses are ineffective against this novel attack due to its fundamentally different mechanism compared to classic ones. In this work, we propose a novel data-free defense strategy that addresses both classic and novel backdoor attacks in FL. The shared attack pattern lies in the abnormal activations within the hidden feature space during model aggregation. Hence, we propose to constrain internal activations to remain within reasonable ranges, effectively mitigating attacks while preserving model functionality. The activation constraints are optimized using synthetic data alongside FL training. Extensive experiments demonstrate its effectiveness against both novel and classic backdoor attacks, outperforming existing defenses.

📄 PDF Abstract BibTeX arXiv:2410.17573

Code (0)

등록된 구현이 없습니다.

Tasks

Backdoor AttackFederated Learning

Similar Papers 제목 키워드 기반

Backdooring Vision-Language Models with Out-Of-Distribution Data

2024-10-02 · Weimin Lyu, Jiachen Yao, Saumya Gupta, Lu Pang 외

The emergence of Vision-Language Models (VLMs) represents a significant advancement in integrating computer vision with Large Language Models (LLMs) to generate detailed text descriptions from visual inputs. Despite thei…

Image CaptioningImage to textQuestion AnsweringVisual Question Answering+1

Foundation Models in Federated Learning: Assessing Backdoor Vulnerabilities

2024-01-18 · Xi Li, Chen Wu, Jiaqi Wang

Federated Learning (FL), a privacy-preserving machine learning framework, faces significant data-related challenges. For example, the lack of suitable public datasets leads to ineffective information exchange, especially…

Federated LearningPrivacy Preserving

TrojVLM: Backdoor Attack Against Vision Language Models

2024-09-28 · Weimin Lyu, Lu Pang, Tengfei Ma, Haibin Ling 외

The emergence of Vision Language Models (VLMs) is a significant advancement in integrating computer vision with Large Language Models (LLMs) to produce detailed text descriptions based on visual inputs, yet it introduces…

Backdoor AttackImage CaptioningImage to textQuestion Answering+3

Model Poisoning Against Federated Model Adaptation with Chain of Bit-Flips

2026-06-08 · Bastien Vuillod, Kevin Hector, Pierre-Alain Moellic, Jean-Max Dutertre 외 arxiv

Federated Learning (FL) allows a set of clients to collectively train a global model without sharing local training data. Giving the responsibility of the training to decentralized actors may lead to poisoning attacks: c…

Federated Learning

STONE: Pioneering the One-to-N Universal Backdoor Threat in 3D Point Cloud

2025-11-14 · Dongmei Shan, Wei Lian, Chongxia Wang arxiv

Backdoor attacks pose a critical threat to deep learning, especially in safety-sensitive 3D domains such as autonomous driving and robotics. While potent, existing attacks on 3D point clouds are predominantly limited to …

Autonomous DrivingPoint Clouds