Generalizable Resource Allocation in Stream Processing via Deep Reinforcement Learning

2019-11-19 · Xiang Ni, Jing Li, Mo Yu, Wang Zhou, Kun-Lung Wu

This paper considers the problem of resource allocation in stream processing, where continuous data flows must be processed in real time in a large distributed system. To maximize system throughput, the resource allocation strategy that partitions the computation tasks of a stream processing graph onto computing devices must simultaneously balance workload distribution and minimize communication. Since this problem of graph partitioning is known to be NP-complete yet crucial to practical streaming systems, many heuristic-based algorithms have been developed to find reasonably good solutions. In this paper, we present a graph-aware encoder-decoder framework to learn a generalizable resource allocation strategy that can properly distribute computation tasks of stream processing graphs unobserved from training data. We, for the first time, propose to leverage graph embedding to learn the structural information of the stream processing graphs. Jointly trained with the graph-aware decoder using deep reinforcement learning, our approach can effectively find optimized solutions for unseen graphs. Our experiments show that the proposed model outperforms both METIS, a state-of-the-art graph partitioning algorithm, and an LSTM-based encoder-decoder model, in about 70% of the test cases.

📄 PDF Abstract BibTeX arXiv:1911.08517

Code (1)

xiangni/DREAM 공식 구현 tf

Tasks

DecoderDeep Reinforcement LearningGraph Embedding graph partitioning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Test 설명 없음

Towards a Proactive Autoscaling Framework for Data Stream Processing at the Edge using GRU and Transfer Learning

2025-07-19 · Eugene Armah, Linda Amoako Bannning arxiv

Processing data at high speeds is becoming increasingly critical as digital economies generate enormous data. The current paradigms for timely data processing are edge computing and data stream processing (DSP). Edge com…

Reinforcement Learning Transfer Learning

Reinforcement Learning on Computational Resource Allocation of Cloud-based Wireless Networks

2020-10-10 · Beiran Chen, Yi Zhang, George Iosifidis, Mingming Liu

Wireless networks used for Internet of Things (IoT) are expected to largely involve cloud-based computing and processing. Softwarised and centralised signal processing and network switching in the cloud enables flexible …

CPU Management Model-based Reinforcement Learning reinforcement-learning+2

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

2023-12-13 · Xin Hao, Phee Lep Yeoh, Changyang She, Branka Vucetic 외

This paper proposes a blockchain-secured deep reinforcement learning (BC-DRL) optimization framework for {data management and} resource allocation in decentralized {wireless mobile edge computing (MEC)} networks. In our …

Deep Reinforcement Learning Edge-computing Management

FlagVNE: A Flexible and Generalizable Reinforcement Learning Framework for Network Resource Allocation

2024-04-19 · Tianfu Wang, Qilin Fan, Chao Wang, Long Yang 외

Virtual network embedding (VNE) is an essential resource allocation task in network virtualization, aiming to map virtual network requests (VNRs) onto physical infrastructure. Reinforcement learning (RL) has recently eme…

Decoder Network Embedding Reinforcement Learning (RL)Scheduling

ContainerGym: A Real-World Reinforcement Learning Benchmark for Resource Allocation

2023-07-06 · Abhijeet Pendyala, Justin Dettmer, Tobias Glasmachers, Asma Atamna

We present ContainerGym, a benchmark for reinforcement learning inspired by a real-world industrial resource allocation task. The proposed benchmark encodes a range of challenges commonly encountered in real-world sequen…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1