paper-with-me

Papers

Online Adaptive Learning for Runtime Resource Management of Heterogeneous SoCs

2020-08-22 · Sumit K. Mandal, Umit Y. Ogras, Janardhan Rao Doppa, Raid Z. Ayoub, Michael Kishinevsky, Partha P. Pande

Dynamic resource management has become one of the major areas of research in modern computer and communication system design due to lower power consumption and higher performance demands. The number of integrated cores, level of heterogeneity and amount of control knobs increase steadily. As a result, the system complexity is increasing faster than our ability to optimize and dynamically manage the resources. Moreover, offline approaches are sub-optimal due to workload variations and large volume of new applications unknown at design time. This paper first reviews recent online learning techniques for predicting system performance, power, and temperature. Then, we describe the use of predictive models for online control using two modern approaches: imitation learning (IL) and an explicit nonlinear model predictive control (NMPC). Evaluations on a commercial mobile platform with 16 benchmarks show that the IL approach successfully adapts the control policy to unknown applications. The explicit NMPC provides 25% energy savings compared to a state-of-the-art algorithm for multi-variable power management of modern GPU sub-systems.

📄 PDF Abstract BibTeX arXiv:2008.09728

Code (0)

등록된 구현이 없습니다.

Tasks

GPUImitation LearningManagementModel Predictive Control

Similar Papers 제목 키워드 기반

DriftSched: Adaptive QoS-Aware Scheduling under Runtime Token Drift for Multi-Tenant GPU Inference

2026-06-02 · Kathiravan Palaniappan arxiv

The rapid growth of large language model (LLM) inference services has increased the demand for efficient multi-tenant GPU scheduling. While modern inference runtimes such as vLLM improve throughput through continuous bat…

Optimistic Learning for Communication Networks

2025-04-04 · George Iosifidis, Naram Mhaisen, Douglas J. Leith

AI/ML-based tools are at the forefront of resource management solutions for communication networks. Deep learning, in particular, is highly effective in facilitating fast and high-performing decision-making whenever repr…

Edge-computingManagement

Dynamic DNNs and Runtime Management for Efficient Inference on Mobile/Embedded Devices

2024-01-17 · Lei Xun, Jonathon Hare, Geoff V. Merrett

Deep neural network (DNN) inference is increasingly being executed on mobile and embedded platforms due to several key advantages in latency, privacy and always-on availability. However, due to limited computing resource…

Dynamic neural networksGPUManagementModel Compression

An Energy-Aware Online Learning Framework for Resource Management in Heterogeneous Platforms

2020-03-20 · Sumit K. Mandal, Ganapati Bhat, Janardhan Rao Doppa, Partha Pratim Pande 외

Mobile platforms must satisfy the contradictory requirements of fast response time and minimum energy consumption as a function of dynamically changing applications. To address this need, system-on-chips (SoC) that are a…

Imitation LearningManagement

Adaptive Measurement-Based Policy-Driven QoS Management with Fuzzy-Rule-based Resource Allocation

2013-11-06 · Suleiman Y. Yerima, Gerard P. Parr, Sally I. McClean, Philip J. Morrow

Fixed and wireless networks are increasingly converging towards common connectivity with IP-based core networks. Providing effective end-to-end resource and QoS management in such complex heterogeneous converged network …

Management