Data Valuation and Detections in Federated Learning
Federated Learning (FL) enables collaborative model training while preserving the privacy of raw data. A challenge in this framework is the fair and efficient valuation of data, which is crucial for incentivizing clients to contribute high-quality data in the FL task. In scenarios involving numerous data clients within FL, it is often the case that only a subset of clients and datasets are pertinent to a specific learning task, while others might have either a negative or negligible impact on the model training process. This paper introduces a novel privacy-preserving method for evaluating client contributions and selecting relevant datasets without a pre-specified training algorithm in an FL task. Our proposed approach FedBary, utilizes Wasserstein distance within the federated context, offering a new solution for data valuation in the FL framework. This method ensures transparent data valuation and efficient computation of the Wasserstein barycenter and reduces the dependence on validation datasets. Through extensive empirical experiments and theoretical analyses, we demonstrate the potential of this data valuation method as a promising avenue for FL research.
Code (1)
Tasks
Data ValuationFederated LearningPrivacy PreservingSimilar Papers 제목 키워드 기반
SoftED: Metrics for Soft Evaluation of Time Series Event Detection
Time series event detection methods are evaluated mainly by standard classification metrics that focus solely on detection accuracy. However, inaccuracy in detecting an event can often result from its preceding or delaye…
Event DetectionTime SeriesRadar Artifact Labeling Framework (RALF): Method for Plausible Radar Detections in Datasets
Research on localization and perception for Autonomous Driving is mainly focused on camera and LiDAR datasets, rarely on radar data. Manually labeling sparse radar point clouds is challenging. For a dataset generation, w…
Autonomous DrivingDataset GenerationDepth Image EstimationA Flow-based Credibility Metric for Safety-critical Pedestrian Detection
Safety is of utmost importance for perception in automated driving (AD). However, a prime safety concern in state-of-the art object detection is that standard evaluation schemes utilize safety-agnostic metrics to argue s…
object-detectionObject DetectionOptical Flow EstimationPedestrian DetectionExploring Local Context for Multi-target Tracking in Wide Area Aerial Surveillance
Tracking many vehicles in wide coverage aerial imagery is crucial for understanding events in a large field of view. Most approaches aim to associate detections from frame differencing into tracks. However, slow or stopp…
Optimal Correction Cost for Object Detection Evaluation
Mean Average Precision (mAP) is the primary evaluation measure for object detection. Although object detection has a broad range of applications, mAP evaluates detectors in terms of the performance of ranked instance ret…
Objectobject-detectionObject DetectionRetrieval