Federated Momentum Contrastive Clustering

2022-06-10 · Runxuan Miao, Erdem Koyuncu

We present federated momentum contrastive clustering (FedMCC), a learning framework that can not only extract discriminative representations over distributed local data but also perform data clustering. In FedMCC, a transformed data pair passes through both the online and target networks, resulting in four representations over which the losses are determined. The resulting high-quality representations generated by FedMCC can outperform several existing self-supervised learning methods for linear evaluation and semi-supervised learning tasks. FedMCC can easily be adapted to ordinary centralized clustering through what we call momentum contrastive clustering (MCC). We show that MCC achieves state-of-the-art clustering accuracy results in certain datasets such as STL-10 and ImageNet-10. We also present a method to reduce the memory footprint of our clustering schemes.

📄 PDF Abstract BibTeX arXiv:2206.05093

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringLinear evaluationSelf-Supervised Learning

CCFC: Bridging Federated Clustering and Contrastive Learning

2024-01-12 · Jie Yan, Jing Liu, Zhong-Yuan Zhang

Federated clustering, an essential extension of centralized clustering for federated scenarios, enables multiple data-holding clients to collaboratively group data while keeping their data locally. In centralized scenari…

Clustering Contrastive Learning Representation Learning

Unsupervised Visual Representation Learning by Synchronous Momentum Grouping

2022-07-13 · Bo Pang, Yifan Zhang, Yaoyi Li, Jia Cai 외

In this paper, we propose a genuine group-level contrastive visual representation learning method whose linear evaluation performance on ImageNet surpasses the vanilla supervised learning. Two mainstream unsupervised lea…

Clustering Contrastive Learning Linear evaluation Representation Learning+1

Federated Contrastive Learning of Graph-Level Representations

2024-11-18 · Xiang Li, Gagan Agrawal, Rajiv Ramnath, Ruoming Jin

Graph-level representations (and clustering/classification based on these representations) are required in a variety of applications. Examples include identifying malicious network traffic, prediction of protein properti…

Clustering Contrastive Learning Federated Learning Traffic Prediction

Self-supervised Text-independent Speaker Verification using Prototypical Momentum Contrastive Learning

2020-12-13 · Wei Xia, Chunlei Zhang, Chao Weng, Meng Yu 외

In this study, we investigate self-supervised representation learning for speaker verification (SV). First, we examine a simple contrastive learning approach (SimCLR) with a momentum contrastive (MoCo) learning framework…

Clustering Contrastive Learning Representation Learning Speaker Verification+1

A deep cut into Split Federated Self-supervised Learning

2024-06-12 · Marcin Przewięźlikowski, Marcin Osial, Bartosz Zieliński, Marek Śmieja

Collaborative self-supervised learning has recently become feasible in highly distributed environments by dividing the network layers between client devices and a central server. However, state-of-the-art methods, such a…

Federated Learning Self-Supervised Learning