paper-with-me

Papers

Game-Theoretic Deep Reinforcement Learning to Minimize Carbon Emissions and Energy Costs for AI Inference Workloads in Geo-Distributed Data Centers

2024-04-01 · Ninad Hogade, Sudeep Pasricha

Data centers are increasingly using more energy due to the rise in Artificial Intelligence (AI) workloads, which negatively impacts the environment and raises operational costs. Reducing operating expenses and carbon emissions while maintaining performance in data centers is a challenging problem. This work introduces a unique approach combining Game Theory (GT) and Deep Reinforcement Learning (DRL) for optimizing the distribution of AI inference workloads in geo-distributed data centers to reduce carbon emissions and cloud operating (energy + data transfer) costs. The proposed technique integrates the principles of non-cooperative Game Theory into a DRL framework, enabling data centers to make intelligent decisions regarding workload allocation while considering the heterogeneity of hardware resources, the dynamic nature of electricity prices, inter-data center data transfer costs, and carbon footprints. We conducted extensive experiments comparing our game-theoretic DRL (GT-DRL) approach with current DRL-based and other optimization techniques. The results demonstrate that our strategy outperforms the state-of-the-art in reducing carbon emissions and minimizing cloud operating costs without compromising computational performance. This work has significant implications for achieving sustainability and cost-efficiency in data centers handling AI inference workloads across diverse geographic locations.

📄 PDF Abstract BibTeX arXiv:2404.01459

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Similar Papers 제목 키워드 기반

MARLIN: Multi-Agent Game-Theoretic Reinforcement Learning for Sustainable LLM Inference in Cloud Datacenters

2026-05-13 · H. Moore, S. Qi, D. Milojicic, C. Bash 외 arxiv

Large Language Models (LLMs) have become increasingly prevalent in cloud-based platforms, propelled by the introduction of AI-based consumer and enterprise services. LLM inference requests in particular account for up to…

Reinforcement Learning

Joint Trading and Scheduling among Coupled Carbon-Electricity-Heat-Gas Industrial Clusters

2023-12-20 · Dafeng Zhu, Bo Yang, Yu Wu, Haoran Deng 외

This paper presents a carbon-energy coupling management framework for an industrial park, where the carbon flow model accompanying multi-energy flows is adopted to track and suppress carbon emissions on the user side. To…

energy tradingManagementScheduling

Towards net-zero manufacturing: carbon-aware scheduling for GHG emissions reduction

2025-03-03 · Andrea Mencaroni, Pieter Leyman, Birger Raa, Stijn De Vuyst 외

Detailed scheduling has traditionally been optimized for the reduction of makespan and manufacturing costs. However, growing awareness of environmental concerns and increasingly stringent regulations are pushing manufact…

Scheduling

GAR: Carbon-Aware Routing for LLM Inference via Constrained Optimization

2026-05-12 · Disha Sheshanarayana, Rajat Subhra Pal, Manjira Sinha, Tirthankar Dasgupta arxiv

The growing deployment of large language models (LLMs) makes per-request routing essential for balancing response quality and computational cost across heterogeneous model pools. Current routing methods rarely consider s…

A Vertical Approach to Designing and Managing Sustainable Heterogeneous Edge Data Centers

2025-06-02 · Aikaterini Maria Panteleaki, Varatheepan Paramanayakam, Vasileios Pentsos, Andreas Karatzas 외

The increasing demand for Artificial Intelligence (AI) computing poses significant environmental challenges, with both operational and embodied carbon emissions becoming major contributors. This paper presents a carbon-a…

Scheduling