paper-with-me

홈 › Papers

DCoPilot: Generative AI-Empowered Policy Adaptation for Dynamic Data Center Operations

2026-02-02 · Minghao Li, Ruihang Wang, Rui Tan, Yonggang Wen arxiv

Modern data centers (DCs) hosting artificial intelligence (AI)-dedicated devices operate at high power densities with rapidly varying workloads, making minute-level adaptation essential for safe and energy-efficient operation. However, manually designing piecewise deep reinforcement learning (DRL) agents cannot keep pace with frequent dynamics shifts and service-level agreement (SLA) changes of an evolving DC. This specification-to-policy lag causes a lack of timely, effective control policies, which may lead to service outages. To bridge the gap, we present DCoPilot, a hybrid framework for generative control policies in dynamic DC operation. DCoPilot synergizes two distinct generative paradigms, i.e., a large language model (LLM) that performs symbolic generation of structured reward forms, and a hypernetwork that conducts parametric generation of policy weights. DCoPilot operates through three coordinated phases: (i) simulation scale-up, which stress-tests reward candidates across diverse simulation-ready (SimReady) scenes; (ii) meta policy distillation, where a hypernetwork is trained to output policy weights conditioned on SLA and scene embeddings; and (iii) online adaptation, enabling zero-shot policy generation in response to updated specifications. Evaluated across five control task families spanning diverse DC components, DCoPilot achieves near-zero constraint violations and outperforms all baselines across specification variations. Ablation studies validate the effectiveness of LLM-based unified reward generation in enabling stable hypernetwork convergence.

📄 PDF Abstract BibTeX arXiv:2602.02137

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Do It For Me vs. Do It With Me: Investigating User Perceptions of Different Paradigms of Automation in Copilots for Feature-Rich Software

2025-04-22 · Anjali Khurana, Xiaotian Su, April Yi Wang, Parmit K Chilana

Large Language Model (LLM)-based in-application assistants, or copilots, can automate software tasks, but users often prefer learning by doing, raising questions about the optimal level of automation for an effective use…

Language ModelingLanguage ModellingLarge Language Model

Joint Task Offloading, Inference Optimization and UAV Trajectory Planning for Generative AI Empowered Intelligent Transportation Digital Twin

2026-04-09 · Xiaohuan Li, Junchuan Fan, Bingqi Zhang, Rong Yu 외 arxiv

To implement the intelligent transportation digital twin (ITDT), unmanned aerial vehicles (UAVs) are scheduled to process the sensing data from the roadside sensors. At this time, generative artificial intelligence (GAI)…

Trajectory Planning

DADiff: Diffusion-Driven Cross-Domain Policy Adaptation for Reinforcement Learning

2026-07-17 · Hanyang Chen, Anirudh Satheesh, Longchao Da, Hua Wei arxiv

Transferring policies across domains poses a vital challenge in reinforcement learning, due to the dynamics mismatch between the source and target domains. In this paper, we consider the setting of online dynamics adapta…

Representation LearningReinforcement LearningDomain Adaptation

Off-Dynamics Reinforcement Learning via Domain Adaptation and Reward Augmented Imitation

2024-11-15 · Yihong Guo, YiXuan Wang, Yuanyuan Shi, Pan Xu 외

Training a policy in a source domain for deployment in the target domain under a dynamics shift can be challenging, often resulting in performance degradation. Previous work tackles this challenge by training on the sour…

Domain AdaptationImitation Learning

LLM-Empowered Agentic MAC Protocols: A Dynamic Stackelberg Game Approach

2025-10-13 · Renxuan Tan, Rongpeng Li, Fei Wang, Chenghui Peng 외 arxiv

Medium Access Control (MAC) protocols, essential for wireless networks, are typically manually configured. While deep reinforcement learning (DRL)-based protocols enhance task-specified network performance, they suffer f…

Reinforcement Learning