Adversarial Collaborative Learning on Non-IID Features
Federated learning has been a popular approach to enable collaborative learning on multiple parties without exchanging raw data. However, the model performance of federated learning may degrade a lot due to non-IID data. While most existing studies focus on non-IID labels, federated learning on non-IID features has largely been overlooked. Different from typical federated learning approaches, the paper proposes a new learning concept called ADCOL (Adversarial Collaborative Learning) for non-IID features. Instead of adopting the widely used model-averaging scheme, ADCOL conducts training in an adversarial way: the server aims to train a discriminator to distinguish the representations of the parties, while the parties aim to generate a common representation distribution. Our experiments on three real-world datasets show that ADCOL achieves better accuracy and is much more communication-efficient than state-of-the-art federated learning algorithms on non-IID features. More importantly, ADCOL points out a promising research direction for collaborative learning.
Code (1)
Tasks
Federated LearningSimilar Papers 제목 키워드 기반
Uncertainty Quantification for Collaborative Object Detection Under Adversarial Attacks
Collaborative Object Detection (COD) and collaborative perception can integrate data or features from various entities, and improve object detection accuracy compared with individual perception. However, adversarial atta…
Adversarial RobustnessAutonomous DrivingAutonomous VehiclesConformal Prediction+4PATROL: Privacy-Oriented Pruning for Collaborative Inference Against Model Inversion Attacks
Collaborative inference has been a promising solution to enable resource-constrained edge devices to perform inference using state-of-the-art deep neural networks (DNNs). In collaborative inference, the edge device first…
Collaborative InferenceVehicle Re-IdentificationMulti-Paradigm Collaborative Adversarial Attack Against Multi-Modal Large Language Models
The rapid progress of Multi-Modal Large Language Models (MLLMs) has significantly advanced downstream applications. However, this progress also exposes serious transferable adversarial vulnerabilities. In general, existi…
Adversarial AttackFedPall: Prototype-based Adversarial and Collaborative Learning for Federated Learning with Feature Drift
Federated learning (FL) enables collaborative training of a global model in the centralized server with data from multiple parties while preserving privacy. However, data heterogeneity can significantly degrade the perfo…
Federated LearningA Survey on Intermediate Fusion Methods for Collaborative Perception Categorized by Real World Challenges
This survey analyzes intermediate fusion methods in collaborative perception for autonomous driving, categorized by real-world challenges. We examine various methods, detailing their features and the evaluation metrics t…
Autonomous Driving