Learning Runtime Parameters in Computer Systems with Delayed Experience Injection
Learning effective configurations in computer systems without hand-crafting models for every parameter is a long-standing problem. This paper investigates the use of deep reinforcement learning for runtime parameters of cloud databases under latency constraints. Cloud services serve up to thousands of concurrent requests per second and can adjust critical parameters by leveraging performance metrics. In this work, we use continuous deep reinforcement learning to learn optimal cache expirations for HTTP caching in content delivery networks. To this end, we introduce a technique for asynchronous experience management called delayed experience injection, which facilitates delayed reward and next-state computation in concurrent environments where measurements are not immediately available. Evaluation results show that our approach based on normalized advantage functions and asynchronous CPU-only training outperforms a statistical estimator.
Code (0)
등록된 구현이 없습니다.
Tasks
CPUDeep Reinforcement LearningManagementreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Interference-Aware Edge Runtime Prediction with Conformal Matrix Completion
Accurately estimating workload runtime is a longstanding goal in computer systems, and plays a key role in efficient resource provisioning, latency minimization, and various other system management tasks. Runtime predict…
Edge-computingMatrix CompletionPredictionApproximating Stacked and Bidirectional Recurrent Architectures with the Delayed Recurrent Neural Network
Recent work has shown that topological enhancements to recurrent neural networks (RNNs) can increase their expressiveness and representational capacity. Two popular enhancements are stacked RNNs, which increases the capa…
Computer Vision Model Compression Techniques for Embedded Systems: A Survey
Deep neural networks have consistently represented the state of the art in most computer vision problems. In these scenarios, larger and more complex models have demonstrated superior performance to smaller architectures…
Model CompressionSurveyImproving endpoint detection in end-to-end streaming ASR for conversational speech
ASR endpointing (EP) plays a major role in delivering a good user experience in products supporting human or artificial agents in human-human/machine conversations. Transducer-based ASR (T-ASR) is an end-to-end (E2E) ASR…
Action DetectionActivity DetectionRLCache: Automated Cache Management Using Reinforcement Learning
This study investigates the use of reinforcement learning to guide a general purpose cache manager decisions. Cache managers directly impact the overall performance of computer systems. They govern decisions about which …
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)