paper-with-me

홈 › Papers

CoRe-Fed: Bridging Collaborative and Representation Fairness via Federated Embedding Distillation

2026-01-31 · Noorain Mukhtiar, Adnan Mahmood, Quan Z. Sheng arxiv

With the proliferation of distributed data sources, Federated Learning (FL) has emerged as a key approach to enable collaborative intelligence through decentralized model training while preserving data privacy. However, conventional FL algorithms often suffer from performance disparities across clients caused by heterogeneous data distributions and unequal participation, which leads to unfair outcomes. Specifically, we focus on two core fairness challenges, i.e., representation bias, arising from misaligned client representations, and collaborative bias, stemming from inequitable contribution during aggregation, both of which degrade model performance and generalizability. To mitigate these disparities, we propose CoRe-Fed, a unified optimization framework that bridges collaborative and representation fairness via embedding-level regularization and fairness-aware aggregation. Initially, an alignment-driven mechanism promotes semantic consistency between local and global embeddings to reduce representational divergence. Subsequently, a dynamic reward-penalty-based aggregation strategy adjusts each client's weight based on participation history and embedding alignment to ensure contribution-aware aggregation. Extensive experiments across diverse models and datasets demonstrate that CoRe-Fed improves both fairness and model performance over the state-of-the-art baseline algorithms.

📄 PDF Abstract BibTeX arXiv:2602.00647

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

Dynamic Fair Federated Learning Based on Reinforcement Learning

2023-11-02 · Weikang Chen, Junping Du, Yingxia Shao, Jia Wang 외

Federated learning enables a collaborative training and optimization of global models among a group of devices without sharing local data samples. However, the heterogeneity of data in federated learning can lead to unfa…

FairnessFederated Learningreinforcement-learningReinforcement Learning

CCFC: Bridging Federated Clustering and Contrastive Learning

2024-01-12 · Jie Yan, Jing Liu, Zhong-Yuan Zhang

Federated clustering, an essential extension of centralized clustering for federated scenarios, enables multiple data-holding clients to collaboratively group data while keeping their data locally. In centralized scenari…

ClusteringContrastive LearningRepresentation Learning

Collaborative Fairness in Federated Learning

2020-08-27 · Lingjuan Lyu, Xinyi Xu, Qian Wang

In current deep learning paradigms, local training or the Standalone framework tends to result in overfitting and thus poor generalizability. This problem can be addressed by Distributed or Federated Learning (FL) that l…

Collaborative FairnessFairnessFederated Learning

FedSAC: Dynamic Submodel Allocation for Collaborative Fairness in Federated Learning

2024-05-28 · Zihui Wang, Zheng Wang, Lingjuan Lyu, Zhaopeng Peng 외

Collaborative fairness stands as an essential element in federated learning to encourage client participation by equitably distributing rewards based on individual contributions. Existing methods primarily focus on adjus…

Collaborative FairnessFairnessFederated Learning

PluralLLM: Pluralistic Alignment in LLMs via Federated Learning

2025-03-13 · Mahmoud Srewa, Tianyu Zhao, Salma Elmalaki

Ensuring Large Language Models (LLMs) align with diverse human preferences while preserving privacy and fairness remains a challenge. Existing methods, such as Reinforcement Learning from Human Feedback (RLHF), rely on c…

FairnessFederated LearningPrivacy Preserving