paper-with-me

Papers

Jigsaw Game: Federated Clustering

2024-07-17 · Jinxuan Xu, Hong-You Chen, Wei-Lun Chao, Yuqian Zhang

Federated learning has recently garnered significant attention, especially within the domain of supervised learning. However, despite the abundance of unlabeled data on end-users, unsupervised learning problems such as clustering in the federated setting remain underexplored. In this paper, we investigate the federated clustering problem, with a focus on federated k-means. We outline the challenge posed by its non-convex objective and data heterogeneity in the federated framework. To tackle these challenges, we adopt a new perspective by studying the structures of local solutions in k-means and propose a one-shot algorithm called FeCA (Federated Centroid Aggregation). FeCA adaptively refines local solutions on clients, then aggregates these refined solutions to recover the global solution of the entire dataset in a single round. We empirically demonstrate the robustness of FeCA under various federated scenarios on both synthetic and real-world data. Additionally, we extend FeCA to representation learning and present DeepFeCA, which combines DeepCluster and FeCA for unsupervised feature learning in the federated setting.

📄 PDF Abstract BibTeX arXiv:2407.12764

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringFederated LearningRepresentation Learning

Methods 이 논문이 사용한 방법론

k-Means Clustering k-Means Clustering is a clustering algorithm that divides a training set into $k$ different clusters of examples that are near each other. It works by initializing $k$…
DeepCluster DeepCluster is a self-supervision approach for learning image representations. DeepCluster iteratively groups the features with a standard clustering algorithm, k-means, and…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Grid Jigsaw Representation with CLIP: A New Perspective on Image Clustering

2023-10-27 · Zijie Song, Zhenzhen Hu, Richang Hong

Unsupervised representation learning for image clustering is essential in computer vision. Although the advancement of visual models has improved image clustering with efficient visual representations, challenges still r…

ClusteringImage ClusteringRepresentation Learning

Jigsaw Clustering for Unsupervised Visual Representation Learning

2021-04-01 · CVPR 2021 1 · Pengguang Chen, Shu Liu, Jiaya Jia

Unsupervised representation learning with contrastive learning achieved great success. This line of methods duplicate each training batch to construct contrastive pairs, making each training batch and its augmented versi…

ClusteringContrastive LearningRepresentation Learning

Solving Mixed-Modal Jigsaw Puzzle for Fine-Grained Sketch-Based Image Retrieval

2020-06-01 · CVPR 2020 6 · Kaiyue Pang, Yongxin Yang, Timothy M. Hospedales, Tao Xiang 외

ImageNet pre-training has long been considered crucial by the fine-grained sketch-based image retrieval (FG-SBIR) community due to the lack of large sketch-photo paired datasets for FG-SBIR training. In this paper, we pr…

Image RetrievalRetrievalSketch-Based Image Retrieval

Alphazzle: Jigsaw Puzzle Solver with Deep Monte-Carlo Tree Search

2023-02-01 · Marie-Morgane Paumard, Hedi Tabia, David Picard

Solving jigsaw puzzles requires to grasp the visual features of a sequence of patches and to explore efficiently a solution space that grows exponentially with the sequence length. Therefore, visual deep reinforcement le…

Deep Reinforcement Learning

Federated Learning as a Mean-Field Game

2021-07-08 · Arash Mehrjou

We establish a connection between federated learning, a concept from machine learning, and mean-field games, a concept from game theory and control theory. In this analogy, the local federated learners are considered as …

Federated LearningPrivacy Preserving