QoS-Aware Power Minimization of Distributed Many-Core Servers using Transfer Q-Learning
Web servers scaled across distributed systems necessitate complex runtime controls for providing quality of service (QoS) guarantees as well as minimizing the energy costs under dynamic workloads. This paper presents a QoS-aware runtime controller using horizontal scaling (node allocation) and vertical scaling (resource allocation within nodes) methods synergistically to provide adaptation to workloads while minimizing the power consumption under QoS constraint (i.e., response time). A horizontal scaling determines the number of active nodes based on workload demands and the required QoS according to a set of rules. Then, it is coupled with vertical scaling using transfer Q-learning, which further tunes power/performance based on workload profile using dynamic voltage/frequency scaling (DVFS). It transfers Q-values within minimally explored states reducing exploration requirements. In addition, the approach exploits a scalable architecture of the many-core server allowing to reuse available knowledge from fully or partially explored nodes. When combined, these methods allow to reduce the exploration time and QoS violations when compared to model-free Q-learning. The technique balances design-time and runtime costs to maximize the portability and operational optimality demonstrated through persistent power reductions with minimal QoS violations under different workload scenarios on heterogeneous multi-processing nodes of a server cluster.
Code (0)
등록된 구현이 없습니다.
Tasks
Q-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LSAM: Asynchronous Distributed Training with Landscape-Smoothed Sharpness-Aware Minimization
While Sharpness-Aware Minimization (SAM) improves generalization in deep neural networks by minimizing both loss and sharpness, it suffers from inefficiency in distributed large-batch training. We present Landscape-Smoot…
Power Minimization in Distributed Antenna Systems using Non-Orthogonal Multiple Access and Mutual Successive Interference Cancellation
This paper introduces new approaches for combining non-orthogonal multiple access with distributed antenna systems. The study targets a minimization of the total transmit power in each cell, under user rate and power mul…
Generalized Federated Learning via Sharpness Aware Minimization
Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shif…
Federated LearningPrivacy PreservingMinim: Privacy-Aware Minimal View for Agents via Trusted Local Sanitization
Modern LLM-powered autonomous agents increasingly rely on rich user interface (UI) state observations to achieve reliable action grounding in complex digital environments. However, many deployments transmit the full UI s…
Dynamic Power Balancing Algorithm for Single-Phase Energy Storage Systems in LV Distribution Network with Unbalanced PV Systems Distribution
Unbalanced power, due to high penetration of single-phase PV rooftops into a four-wire multi-grounded LV distribution system, can result in significant rise in the neutral current and neutral voltage. This preprint propo…
Clustering