paper-with-me

홈 › Papers

When Computing Power Network Meets Distributed Machine Learning: An Efficient Federated Split Learning Framework

2023-05-22 · Xinjing Yuan, Lingjun Pu, Lei Jiao, Xiaofei Wang, Meijuan Yang, Jingdong Xu

In this paper, we advocate CPN-FedSL, a novel and flexible Federated Split Learning (FedSL) framework over Computing Power Network (CPN). We build a dedicated model to capture the basic settings and learning characteristics (e.g., training flow, latency and convergence). Based on this model, we introduce Resource Usage Effectiveness (RUE), a novel performance metric integrating training utility with system cost, and formulate a multivariate scheduling problem that maxi?mizes RUE by comprehensively taking client admission, model partition, server selection, routing and bandwidth allocation into account (i.e., mixed-integer fractional programming). We design Refinery, an efficient approach that first linearizes the fractional objective and non-convex constraints, and then solves the transformed problem via a greedy based rounding algorithm in multiple iterations. Extensive evaluations corroborate that CPN-FedSL is superior to the standard and state-of-the-art learning frameworks (e.g., FedAvg and SplitFed), and besides Refinery is lightweight and significantly outperforms its variants and de facto heuristic methods under a variety of settings.

📄 PDF Abstract BibTeX arXiv:2305.12979

Code (0)

등록된 구현이 없습니다.

Tasks

Scheduling

Similar Papers 제목 키워드 기반

Energy Efficient Edge Computing: When Lyapunov Meets Distributed Reinforcement Learning

2021-03-31 · Mohamed Sana, Mattia Merluzzi, Nicola di Pietro, Emilio Calvanese Strinati

In this work, we study the problem of energy-efficient computation offloading enabled by edge computing. In the considered scenario, multiple users simultaneously compete for limited radio and edge computing resources to…

CPUEdge-computingMulti-agent Reinforcement Learningreinforcement-learning+4

Towards an Intelligent Edge: Wireless Communication Meets Machine Learning

2018-09-02 · Guangxu Zhu, Dongzhu Liu, Yuqing Du, Changsheng You 외

The recent revival of artificial intelligence (AI) is revolutionizing almost every branch of science and technology. Given the ubiquitous smart mobile gadgets and Internet of Things (IoT) devices, it is expected that a m…

BIG-bench Machine LearningEdge-computing

When Evolutionary Computation Meets Privacy

2023-03-22 · Bowen Zhao, Wei-neng Chen, Xiaoguo Li, Ximeng Liu 외

Recently, evolutionary computation (EC) has been promoted by machine learning, distributed computing, and big data technologies, resulting in new research directions of EC like distributed EC and surrogate-assisted EC. T…

Distributed ComputingDistributed OptimizationPrivacy Preserving

TonY: An Orchestrator for Distributed Machine Learning Jobs

2019-03-24 · Anthony Hsu, Keqiu Hu, Jonathan Hung, Arun Suresh 외

Training machine learning (ML) models on large datasets requires considerable computing power. To speed up training, it is typical to distribute training across several machines, often with specialized hardware like GPUs…

BIG-bench Machine Learning

Distributed Training of Structured SVM

2015-06-08 · Ching-pei Lee, Kai-Wei Chang, Shyam Upadhyay, Dan Roth

Training structured prediction models is time-consuming. However, most existing approaches only use a single machine, thus, the advantage of computing power and the capacity for larger data sets of multiple machines have…

Structured Prediction