paper-with-me

홈 › Papers

PNCS:Power-Norm Cosine Similarity for Diverse Client Selection in Federated Learning

2025-06-18 · Liangyan Li, Yangyi Liu, Yimo Ning, Stefano Rini, Jun Chen

Federated Learning (FL) has emerged as a powerful paradigm for leveraging diverse datasets from multiple sources while preserving data privacy by avoiding centralized storage. However, many existing approaches fail to account for the intricate gradient correlations between remote clients, a limitation that becomes especially problematic in data heterogeneity scenarios. In this work, we propose a novel FL framework utilizing Power-Norm Cosine Similarity (PNCS) to improve client selection for model aggregation. By capturing higher-order gradient moments, PNCS addresses non-IID data challenges, enhancing convergence speed and accuracy. Additionally, we introduce a simple algorithm ensuring diverse client selection through a selection history queue. Experiments with a VGG16 model across varied data partitions demonstrate consistent improvements over state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2506.15923

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Probabilistic Neural Circuits

2024-03-10 · Pedro Zuidberg Dos Martires

Probabilistic circuits (PCs) have gained prominence in recent years as a versatile framework for discussing probabilistic models that support tractable queries and are yet expressive enough to model complex probability d…

Willkommens-Merkel, Chaos-Johnson, and Tore-Klose: Modeling the Evaluative Meaning of German Personal Name Compounds

2024-04-05 · Annerose Eichel, Tana Deeg, André Blessing, Milena Belosevic 외

We present a comprehensive computational study of the under-investigated phenomenon of personal name compounds (PNCs) in German such as Willkommens-Merkel ('Welcome-Merkel'). Prevalent in news, social media, and politica…

In Defense of Cosine Similarity: Normalization Eliminates the Gauge Freedom

2026-02-23 · Taha Bouhsine arxiv

Steck, Ekanadham, and Kallus [arXiv:2403.05440] demonstrate that cosine similarity of learned embeddings from matrix factorization models can be rendered arbitrary by a diagonal ``gauge'' matrix $D$. Their result is corr…

Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks

2017-02-20 · Chunjie Luo, Jianfeng Zhan, Lei Wang, Qiang Yang

Traditionally, multi-layer neural networks use dot product between the output vector of previous layer and the incoming weight vector as the input to activation function. The result of dot product is unbounded, thus incr…

Is Cosine-Similarity of Embeddings Really About Similarity?

2024-03-08 · Harald Steck, Chaitanya Ekanadham, Nathan Kallus

Cosine-similarity is the cosine of the angle between two vectors, or equivalently the dot product between their normalizations. A popular application is to quantify semantic similarity between high-dimensional objects by…

Semantic SimilaritySemantic Textual Similarity