paper-with-me

Papers

PA-CFL: Privacy-Adaptive Clustered Federated Learning for Transformer-Based Sales Forecasting on Heterogeneous Retail Data

2025-03-15 · Yunbo Long, Liming Xu, Ge Zheng, Alexandra Brintrup

Federated learning (FL) enables retailers to share model parameters for demand forecasting while maintaining privacy. However, heterogeneous data across diverse regions, driven by factors such as varying consumer behavior, poses challenges to the effectiveness of federated learning. To tackle this challenge, we propose Privacy-Adaptive Clustered Federated Learning (PA-CFL) tailored for demand forecasting on heterogeneous retail data. By leveraging differential privacy and feature importance distribution, PA-CFL groups retailers into distinct ``bubbles'', each forming its own federated learning system to effectively isolate data heterogeneity. Within each bubble, Transformer models are designed to predict local sales for each client. Our experiments demonstrate that PA-CFL significantly surpasses FedAvg and outperforms local learning in demand forecasting performance across all participating clients. Compared to local learning, PA-CFL achieves a 5.4% improvement in R^2, a 69% reduction in RMSE, and a 45% decrease in MAE. Our approach enables effective FL through adaptive adjustments to diverse noise levels and the range of clients participating in each bubble. By grouping participants and proactively filtering out high-risk clients, PA-CFL mitigates potential threats to the FL system. The findings demonstrate PA-CFL's ability to enhance federated learning in time series prediction tasks with heterogeneous data, achieving a balance between forecasting accuracy and privacy preservation in retail applications. Additionally, PA-CFL's capability to detect and neutralize poisoned data from clients enhances the system's robustness and reliability.

📄 PDF Abstract BibTeX arXiv:2503.12220

Code (0)

등록된 구현이 없습니다.

Tasks

Demand ForecastingFeature ImportanceFederated LearningPrivacy PreservingTime Series Prediction

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Social-Aware Clustered Federated Learning with Customized Privacy Preservation

2022-12-25 · Yuntao Wang, Zhou Su, Yanghe Pan, Tom H Luan 외

A key feature of federated learning (FL) is to preserve the data privacy of end users. However, there still exist potential privacy leakage in exchanging gradients under FL. As a result, recent research often explores th…

Federated Learning

Novel clustered federated learning based on local loss

2024-07-12 · Endong Gu, Yongxin Chen, Hao Wen, Xingju Cai 외

This paper proposes LCFL, a novel clustering metric for evaluating clients' data distributions in federated learning. LCFL aligns with federated learning requirements, accurately assessing client-to-client variations in …

ClusteringFederated Learning

DAG-ACFL: Asynchronous Clustered Federated Learning based on DAG-DLT

2023-08-25 · Xiaofeng Xue, Haokun Mao, Qiong Li

Federated learning (FL) aims to collaboratively train a global model while ensuring client data privacy. However, FL faces challenges from the non-IID data distribution among clients. Clustered FL (CFL) has emerged as a …

Change Point DetectionFederated Learning

Clustered Data Sharing for Non-IID Federated Learning over Wireless Networks

2023-02-17 · Gang Hu, Yinglei Teng, Nan Wang, F. Richard Yu

Federated Learning (FL) is a novel distributed machine learning approach to leverage data from Internet of Things (IoT) devices while maintaining data privacy. However, the current FL algorithms face the challenges of no…

ClusteringFederated LearningPrivacy Preserving

Brain Age Estimation Using Structural MRI: A Clustered Federated Learning Approach

2023-07-27 · IEEE International Conference on Omni-layer Intelligent Systems (COINS) 2023 7 · Seyyed Saeid Cheshmi, Abtin Mahyar, Anita Soroush, Zahra Rezvani 외

Estimating brain age based on structural Magnetic Resonance Imaging (MRI) is one of the most challenging and prominent areas of research in recent medical imaging and neuroscience studies. The significance of brain age p…

Age EstimationFederated Learning