paper-with-me

홈 › Papers

Sustainability of Data Center Digital Twins with Reinforcement Learning

2024-04-16 · Soumyendu Sarkar, Avisek Naug, Antonio Guillen, Ricardo Luna, Vineet Gundecha, Ashwin Ramesh Babu, Sajad Mousavi

The rapid growth of machine learning (ML) has led to an increased demand for computational power, resulting in larger data centers (DCs) and higher energy consumption. To address this issue and reduce carbon emissions, intelligent design and control of DC components such as IT servers, cabinets, HVAC cooling, flexible load shifting, and battery energy storage are essential. However, the complexity of designing and controlling them in tandem presents a significant challenge. While some individual components like CFD-based design and Reinforcement Learning (RL) based HVAC control have been researched, there's a gap in the holistic design and optimization covering all elements simultaneously. To tackle this, we've developed DCRL-Green, a multi-agent RL environment that empowers the ML community to design data centers and research, develop, and refine RL controllers for carbon footprint reduction in DCs. It is a flexible, modular, scalable, and configurable platform that can handle large High Performance Computing (HPC) clusters. Furthermore, in its default setup, DCRL-Green provides a benchmark for evaluating single as well as multi-agent RL algorithms. It easily allows users to subclass the default implementations and design their own control approaches, encouraging community development for sustainable data centers. Open Source Link: https://github.com/HewlettPackard/dc-rl

📄 PDF Abstract BibTeX arXiv:2404.10786

Code (1)

hewlettpackard/dc-rl 공식 구현 pytorch

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Hierarchical Multi-Agent Framework for Carbon-Efficient Liquid-Cooled Data Center Clusters

2025-02-12 · Soumyendu Sarkar, Avisek Naug, Antonio Guillen, Vineet Gundecha 외

Reducing the environmental impact of cloud computing requires efficient workload distribution across geographically dispersed Data Center Clusters (DCCs) and simultaneously optimizing liquid and air (HVAC) cooling with t…

Cloud ComputingReinforcement Learning (RL)

A Theoretical Framework for Graph-based Digital Twins for Supply Chain Management and Optimization

2025-03-23 · Azmine Toushik Wasi, Mahfuz Ahmed Anik, Abdur Rahman, Md. Iqramul Hoque 외

Supply chain management is growing increasingly complex due to globalization, evolving market demands, and sustainability pressures, yet traditional systems struggle with fragmented data and limited analytical capabiliti…

Data Integrationgraph constructionManagement

Fusion Intelligence for Digital Twinning AI Data Centers: A Synergistic GenAI-PhyAI Approach

2025-05-26 · Ruihang Wang, Minghao Li, Zhiwei Cao, Jimin Jia 외

The explosion in artificial intelligence (AI) applications is pushing the development of AI-dedicated data centers (AIDCs), creating management challenges that traditional methods and standalone AI solutions struggle to …

Current applications and potential future directions of reinforcement learning-based Digital Twins in agriculture

2024-06-13 · Georg Goldenits, Kevin Mallinger, Sebastian Raubitzek, Thomas Neubauer

Digital Twins have gained attention in various industries for simulation, monitoring, and decision-making, relying on ever-improving machine learning models. However, agricultural Digital Twin implementations are limited…

Decision MakingManagementPolicy Gradient Methodsreinforcement-learning+1

Probing the Limits and Capabilities of Diffusion Models for the Anatomic Editing of Digital Twins

2023-12-30 · Karim Kadry, Shreya Gupta, Farhad R. Nezami, Elazer R. Edelman

Numerical simulations can model the physical processes that govern cardiovascular device deployment. When such simulations incorporate digital twins; computational models of patient-specific anatomy, they can expedite an…

Anatomy