Macro-action Multi-time scale Dynamic Programming for Energy Management in Buildings with Phase Change Materials
This paper focuses on energy management in buildings with phase change material (PCM), which is primarily used to improve thermal performance, but can also serve as an energy storage system. In this setting, optimal scheduling of an HVAC system is challenging because of the nonlinear and non-convex characteristics of the PCM, which makes solving the corresponding optimization problem using conventional optimization techniques impractical. Instead, we use dynamic programming (DP) to deal with the nonlinear nature of the PCM. To overcome DP's curse of dimensionality, this paper proposes a novel methodology to reduce the computational burden, while maintaining the quality of the solution. Specifically, the method incorporates approaches from sequential decision making in artificial intelligence, including macro actions and multi-time scale Markov decision processes, coupled with an underlying state-space approximation to reduce the state-space and action-space size. The performance of the method is demonstrated on an energy management problem for a typical residential building located in Sydney, Australia. The results demonstrate that the proposed method performs well with a computational speed-up of up to 12,900 times compared to the direct application of DP.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision Makingenergy managementManagementSchedulingSequential Decision MakingSimilar Papers 제목 키워드 기반
DeePN$^2$: A deep learning-based non-Newtonian hydrodynamic model
A long standing problem in the modeling of non-Newtonian hydrodynamics of polymeric flows is the availability of reliable and interpretable hydrodynamic models that faithfully encode the underlying micro-scale polymer dy…
Deep LearningEconophysics Macroeconomic Model
This paper presents macroeconomic model that is based on parallels between macroeconomic multi-agent systems and multi-particle systems. We use risk ratings of economic agents as their coordinates on economic space. Aggr…
modelEconophysics Beyond General Equilibrium: the Business Cycle Model
Current business cycle theory is an application of the general equilibrium theory. This paper presents the business cycle model without using general equilibrium framework. We treat agents risk assessments as their coord…
modelMultiscale modeling of glioma invasion: from receptor binding to flux-limited macroscopic PDEs
We propose a novel approach to modeling cell migration in an anisotropic environment with biochemical heterogeneity and interspecies interactions, using as a paradigm glioma invasion in brain tissue under the influence o…
Continuification control of large-scale multiagent systems under limited sensing and structural perturbations
We investigate the stability and robustness properties of a continuification-based strategy for the control of large-scale multiagent systems. Within continuation-based strategy, one transforms the microscopic, agent-lev…