GiPH: Generalizable Placement Learning for Adaptive Heterogeneous Computing
Careful placement of a computational application within a target device cluster is critical for achieving low application completion time. The problem is challenging due to its NP-hardness and combinatorial nature. In recent years, learning-based approaches have been proposed to learn a placement policy that can be applied to unseen applications, motivated by the problem of placing a neural network across cloud servers. These approaches, however, generally assume the device cluster is fixed, which is not the case in mobile or edge computing settings, where heterogeneous devices move in and out of range for a particular application. We propose a new learning approach called GiPH, which learns policies that generalize to dynamic device clusters via 1) a novel graph representation gpNet that efficiently encodes the information needed for choosing a good placement, and 2) a scalable graph neural network (GNN) that learns a summary of the gpNet information. GiPH turns the placement problem into that of finding a sequence of placement improvements, learning a policy for selecting this sequence that scales to problems of arbitrary size. We evaluate GiPH with a wide range of task graphs and device clusters and show that our learned policy rapidly find good placements for new problem instances. GiPH finds placements with up to 30.5% lower completion times, searching up to 3X faster than other search-based placement policies.
Code (1)
Tasks
Edge-computingGraph Neural NetworkMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HEU Emotion: A Large-scale Database for Multi-modal Emotion Recognition in the Wild
The study of affective computing in the wild setting is underpinned by databases. Existing multimodal emotion databases in the real-world conditions are few and small, with a limited number of subjects and expressed in a…
Emotion RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)Multi-factorial Optimization for Large-scale Virtual Machine Placement in Cloud Computing
The placement scheme of virtual machines (VMs) to physical servers (PSs) is crucial to lowering operational cost for cloud providers. Evolutionary algorithms (EAs) have been performed promising-solving on virtual machine…
Cloud ComputingEvolutionary AlgorithmsA Stochastic Surveillance Stackelberg Game: Co-Optimizing Defense Placement and Patrol Strategy
Stochastic patrol routing is known to be advantageous in adversarial settings; however, the optimal choice of stochastic routing strategy is dependent on a model of the adversary. We adopt a worst-case omniscient adversa…
Learning Generalizable Device Placement Algorithms for Distributed Machine Learning
We present Placeto, a reinforcement learning (RL) approach to efficiently find device placements for distributed neural network training. Unlike prior approaches that only find a device placement for a specific computat…
BIG-bench Machine LearningReinforcement LearningReinforcement Learning (RL)Placeto: Learning Generalizable Device Placement Algorithms for Distributed Machine Learning
We present Placeto, a reinforcement learning (RL) approach to efficiently find device placements for distributed neural network training. Unlike prior approaches that only find a device placement for a specific computati…
BIG-bench Machine LearningReinforcement LearningReinforcement Learning (RL)