Smart Information Exchange for Unsupervised Federated Learning via Reinforcement Learning

2024-02-15 · Seohyun Lee, Anindya Bijoy Das, Satyavrat Wagle, Christopher G. Brinton

One of the main challenges of decentralized machine learning paradigms such as Federated Learning (FL) is the presence of local non-i.i.d. datasets. Device-to-device transfers (D2D) between distributed devices has been shown to be an effective tool for dealing with this problem and robust to stragglers. In an unsupervised case, however, it is not obvious how data exchanges should take place due to the absence of labels. In this paper, we propose an approach to create an optimal graph for data transfer using Reinforcement Learning. The goal is to form links that will provide the most benefit considering the environment's constraints and improve convergence speed in an unsupervised FL environment. Numerical analysis shows the advantages in terms of convergence speed and straggler resilience of the proposed method to different available FL schemes and benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2402.09629

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning reinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Embedding Alignment for Unsupervised Federated Learning via Smart Data Exchange

2022-08-04 · Satyavrat Wagle, Seyyedali Hosseinalipour, Naji Khosravan, Mung Chiang 외

Federated learning (FL) has been recognized as one of the most promising solutions for distributed machine learning (ML). In most of the current literature, FL has been studied for supervised ML tasks, in which edge devi…

Contrastive Learning Federated Learning

Unsupervised Federated Optimization at the Edge: D2D-Enabled Learning without Labels

2024-04-15 · Satyavrat Wagle, Seyyedali Hosseinalipour, Naji Khosravan, Christopher G. Brinton

Federated learning (FL) is a popular solution for distributed machine learning (ML). While FL has traditionally been studied for supervised ML tasks, in many applications, it is impractical to assume availability of labe…

Contrastive Learning Federated Learning

AMI-FML: A Privacy-Preserving Federated Machine Learning Framework for AMI

2021-09-13 · Milan Biswal, Abu Saleh Md Tayeen, Satyajayant Misra

Machine learning (ML) based smart meter data analytics is very promising for energy management and demand-response applications in the advanced metering infrastructure(AMI). A key challenge in developing distributed ML a…

BIG-bench Machine Learning energy management Federated Learning Load Forecasting+2

Decentralized Energy Marketplace via NFTs and AI-based Agents

2023-11-17 · Rasoul Nikbakht, Farhana Javed, Farhad Rezazadeh, Nikolaos Bartzoudis 외

The paper introduces an advanced Decentralized Energy Marketplace (DEM) integrating blockchain technology and artificial intelligence to manage energy exchanges among smart homes with energy storage systems. The proposed…

Deep Reinforcement Learning energy management energy trading Management

Federated Reinforcement Distillation with Proxy Experience Memory

2019-07-15 · Han Cha, Jihong Park, Hyesung Kim, Seong-Lyun Kim 외

In distributed reinforcement learning, it is common to exchange the experience memory of each agent and thereby collectively train their local models. The experience memory, however, contains all the preceding state obse…

Privacy Preserving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)