paper-with-me

Papers

Self-supervised On-device Federated Learning from Unlabeled Streams

2022-12-02 · Jiahe Shi, Yawen Wu, Dewen Zeng, Jun Tao, Jingtong Hu, Yiyu Shi

The ubiquity of edge devices has led to a growing amount of unlabeled data produced at the edge. Deep learning models deployed on edge devices are required to learn from these unlabeled data to continuously improve accuracy. Self-supervised representation learning has achieved promising performances using centralized unlabeled data. However, the increasing awareness of privacy protection limits centralizing the distributed unlabeled image data on edge devices. While federated learning has been widely adopted to enable distributed machine learning with privacy preservation, without a data selection method to efficiently select streaming data, the traditional federated learning framework fails to handle these huge amounts of decentralized unlabeled data with limited storage resources on edge. To address these challenges, we propose a Self-supervised On-device Federated learning framework with coreset selection, which we call SOFed, to automatically select a coreset that consists of the most representative samples into the replay buffer on each device. It preserves data privacy as each client does not share raw data while learning good visual representations. Experiments demonstrate the effectiveness and significance of the proposed method in visual representation learning.

📄 PDF Abstract BibTeX arXiv:2212.01006

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningFederated LearningRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Federated Self-Training for Semi-Supervised Audio Recognition

2021-07-14 · Vasileios Tsouvalas, Aaqib Saeed, Tanir Ozcelebi

Federated Learning is a distributed machine learning paradigm dealing with decentralized and personal datasets. Since data reside on devices like smartphones and virtual assistants, labeling is entrusted to the clients, …

Audio ClassificationFederated Learning

FedMAE: Federated Self-Supervised Learning with One-Block Masked Auto-Encoder

2023-03-20 · Nan Yang, Xuanyu Chen, Charles Z. Liu, Dong Yuan 외

Latest federated learning (FL) methods started to focus on how to use unlabeled data in clients for training due to users' privacy concerns, high labeling costs, or lack of expertise. However, current Federated Semi-Supe…

Federated LearningImage ReconstructionSelf-Supervised Learning

Federated Self-Supervised Learning of Multi-Sensor Representations for Embedded Intelligence

2020-07-25 · Aaqib Saeed, Flora D. Salim, Tanir Ozcelebi, Johan Lukkien

Smartphones, wearables, and Internet of Things (IoT) devices produce a wealth of data that cannot be accumulated in a centralized repository for learning supervised models due to privacy, bandwidth limitations, and the p…

Federated LearningSelf-Supervised LearningTransfer Learning

Federated Self-Supervised Contrastive Learning and Masked Autoencoder for Dermatological Disease Diagnosis

2022-08-24 · Yawen Wu, Dewen Zeng, Zhepeng Wang, Yi Sheng 외

In dermatological disease diagnosis, the private data collected by mobile dermatology assistants exist on distributed mobile devices of patients. Federated learning (FL) can use decentralized data to train models while k…

Contrastive LearningFederated LearningSelf-Supervised Learning

Semi-Supervised Federated Learning for Keyword Spotting

2023-05-09 · Enmao Diao, Eric W. Tramel, Jie Ding, Tao Zhang

Keyword Spotting (KWS) is a critical aspect of audio-based applications on mobile devices and virtual assistants. Recent developments in Federated Learning (FL) have significantly expanded the ability to train machine le…

Federated LearningKeyword Spotting