paper-with-me

홈 › Papers

Self-Learning Cloud Controllers: Fuzzy Q-Learning for Knowledge Evolution

2015-07-02 · Pooyan Jamshidi, Amir Sharifloo, Claus Pahl, Andreas Metzger, Giovani Estrada

Cloud controllers aim at responding to application demands by automatically scaling the compute resources at runtime to meet performance guarantees and minimize resource costs. Existing cloud controllers often resort to scaling strategies that are codified as a set of adaptation rules. However, for a cloud provider, applications running on top of the cloud infrastructure are more or less black-boxes, making it difficult at design time to define optimal or pre-emptive adaptation rules. Thus, the burden of taking adaptation decisions often is delegated to the cloud application. Yet, in most cases, application developers in turn have limited knowledge of the cloud infrastructure. In this paper, we propose learning adaptation rules during runtime. To this end, we introduce FQL4KE, a self-learning fuzzy cloud controller. In particular, FQL4KE learns and modifies fuzzy rules at runtime. The benefit is that for designing cloud controllers, we do not have to rely solely on precise design-time knowledge, which may be difficult to acquire. FQL4KE empowers users to specify cloud controllers by simply adjusting weights representing priorities in system goals instead of specifying complex adaptation rules. The applicability of FQL4KE has been experimentally assessed as part of the cloud application framework ElasticBench. The experimental results indicate that FQL4KE outperforms our previously developed fuzzy controller without learning mechanisms and the native Azure auto-scaling.

📄 PDF Abstract BibTeX arXiv:1507.00567

Code (1)

pooyanjamshidi/ElasticBench 공식 구현

Tasks

Q-LearningSelf-Learning

Similar Papers 제목 키워드 기반

Multi-Tasking Genetic Algorithm (MTGA) for Fuzzy System Optimization

2018-12-15 · Dongrui Wu, Xianfeng Tan

Multi-task learning uses auxiliary data or knowledge from relevant tasks to facilitate the learning in a new task. Multi-task optimization applies multi-task learning to optimization to study how to effectively and effic…

Multi-Task Learning

Particle Swarm Optimization for Generating Interpretable Fuzzy Reinforcement Learning Policies

2016-10-19 · Daniel Hein, Alexander Hentschel, Thomas Runkler, Steffen Udluft

Fuzzy controllers are efficient and interpretable system controllers for continuous state and action spaces. To date, such controllers have been constructed manually or trained automatically either using expert-generated…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Unconventional Cognitive Intelligent Robotic Control: Quantum Soft Computing Approach in Human Being Emotion Estimation -- QCOptKB Toolkit Application

2023-06-14 · Sergey V. Ulyanov, Ichiro Kurawaki, Viktor S. Ulyanov, Takakhide Hagiwara

Strategy of intelligent cognitive control systems based on quantum and soft computing presented. Quantum self-organization knowledge base synergetic effect extracted from intelligent fuzzy controllers imperfect knowledge…

From Model-Based and Adaptive Control to Evolving Fuzzy Control

2025-06-07 · Daniel Leite, Igor Škrjanc, Fernando Gomide

Evolving fuzzy systems build and adapt fuzzy models - such as predictors and controllers - by incrementally updating their rule-base structure from data streams. On the occasion of the 60-year anniversary of fuzzy set th…

Speed Control of DC Motor Using Fuzzy PID Controller

2021-08-11 · Messaadi Nassim, Amroun Abdelkader

In this project, we designed a DC motor whose speed can be controlled by a PID controller. The proportional, integral and derivative gains (KP, KI, KD) of the PID controller are adjusted according to Fuzzy logic. First o…