Data-Driven Learning and Load Ensemble Control
Demand response (DR) programs aim to engage distributed small-scale flexible loads, such as thermostatically controllable loads (TCLs), to provide various grid support services. Linearly Solvable Markov Decision Process (LS-MDP), a variant of the traditional MDP, is used to model aggregated TCLs. Then, a model-free reinforcement learning technique called Z-learning is applied to learn the value function and derive the optimal policy for the DR aggregator to control TCLs. The learning process is robust against uncertainty that arises from estimating the passive dynamics of the aggregated TCLs. The efficiency of this data-driven learning is demonstrated through simulations on Heating, Cooling & Ventilation (HVAC) units in a testbed neighborhood of residential houses.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Privacy-Aware Load Ensemble Control: A Linearly-Solvable MDP Approach
Demand response (DR) programs engage distributed demand-side resources, e.g., controllable residential and commercial loads, in providing ancillary services for electric power systems. Ensembles of these resources can he…
Privacy PreservingTunable Experimental Testbed for Evaluating Load Coordination Methods
Driven by the need to offset the variability of wind and solar generation on the electrical grid, development of load controls is a highly active field in the engineering literature. However, practical use of residential…
A Hierarchical Architecture for Optimal Unit Commitment and Control of an Ensemble of Steam Generators
A hierarchical architecture for the optimal management of an ensemble of steam generators is presented. The subsystems are coordinated by a multilayer scheme for jointly sustaining a common load. The high level optimizes…
ManagementModel Predictive ControlStochastic and Distributionally Robust Load Ensemble Control
Demand response (DR) programs aim to engage distributed demand-side resources in providing ancillary services for electric power systems. Previously, aggregated thermostatically controlled loads (TCLs) have been demonstr…
Markovian Decentralized Ensemble Control for Demand Response
With the advancement in smart grid and smart energy devices, demand response becomes one of the most economic and feasible solutions to ease the load stress of the power grids during peak hours. In this work, we propose …