홈 › Papers

Controlling Commercial Cooling Systems Using Reinforcement Learning

2022-11-11 · Jerry Luo, Cosmin Paduraru, Octavian Voicu, Yuri Chervonyi, Scott Munns, Jerry Li, Crystal Qian, Praneet Dutta, Jared Quincy Davis, Ningjia Wu, Xingwei Yang, Chu-Ming Chang, Ted Li, Rob Rose, Mingyan Fan, Hootan Nakhost, Tinglin Liu, Brian Kirkman, Frank Altamura, Lee Cline, Patrick Tonker, Joel Gouker, Dave Uden, Warren Buddy Bryan, Jason Law, Deeni Fatiha, Neil Satra, Juliet Rothenberg, Mandeep Waraich, Molly Carlin, Satish Tallapaka, Sims Witherspoon, David Parish, Peter Dolan, Chenyu Zhao, Daniel J. Mankowitz

This paper is a technical overview of DeepMind and Google's recent work on reinforcement learning for controlling commercial cooling systems. Building on expertise that began with cooling Google's data centers more efficiently, we recently conducted live experiments on two real-world facilities in partnership with Trane Technologies, a building management system provider. These live experiments had a variety of challenges in areas such as evaluation, learning from offline data, and constraint satisfaction. Our paper describes these challenges in the hope that awareness of them will benefit future applied RL work. We also describe the way we adapted our RL system to deal with these challenges, resulting in energy savings of approximately 9% and 13% respectively at the two live experiment sites.

📄 PDF Abstract BibTeX arXiv:2211.07357

Code (0)

등록된 구현이 없습니다.

Tasks

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement Learning-Based Co-Design and Operation of Chiller and Thermal Energy Storage for Cost-Optimal HVAC Systems

2026-01-30 · Tanay Raghunandan Srinivasa, Vivek Deulkar, Aviruch Bhatia, Vishal Garg arxiv

We study the joint operation and sizing of cooling infrastructure for commercial HVAC systems using reinforcement learning, with the objective of minimizing life-cycle cost over a 30-year horizon. The cooling system cons…

Reinforcement Learning

District Cooling System Control for Providing Operating Reserve based on Safe Deep Reinforcement Learning

2021-12-21 · Peipei Yu, Hongxun Hui, Hongcai Zhang, Ge Chen 외

Heating, ventilation, and air conditioning (HVAC) systems are well proved to be capable to provide operating reserve for power systems. As a type of large-capacity and energy-efficient HVAC system (up to 100 MW), distric…

Deep Reinforcement Learning Reinforcement Learning (RL)

Liquid Cooling System for a High Power, Medium Frequency, and Medium Voltage Isolated Power Converter

2023-10-05 · Hooman Taghavi, Ahmad El Shafei, Adel Nasiri

Power electronics systems, widely used in various applications such as industrial automation, electric cars, and renewable energy, have the primary function of converting and controlling electrical power to the desired t…

A novel approach of day-ahead cooling load prediction and optimal control for ice-based thermal energy storage (TES) system in commercial buildings

2025-09-16 · Xuyuan Kang, Xiao Wang, Jingjing An, Da Yan arxiv

Thermal energy storage (TES) is an effective method for load shifting and demand response in buildings. Optimal TES control and management are essential to improve the performance of the cooling system. Most existing TES…

Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control

2021-10-26 · Vinay Hanumaiah, Sahika Genc

It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning (HVAC) systems. Minimizing the energy cost while considering the…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)