paper-with-me

홈 › Papers

Green or Fast? Learning to Balance Cold Starts and Idle Carbon in Serverless Computing

2026-02-27 · Bowen Sun, Christos D. Antonopoulos, Evgenia Smirni, Bin Ren, Nikolaos Bellas, Spyros Lalis arxiv

Serverless computing simplifies cloud deployment but introduces new challenges in managing service latency and carbon emissions. Reducing cold-start latency requires retaining warm function instances, while minimizing carbon emissions favors reclaiming idle resources. This balance is further complicated by time-varying grid carbon intensity and varying workload patterns, under which static keep-alive policies are inefficient. We present LACE-RL, a latency-aware and carbon-efficient management framework that formulates serverless pod retention as a sequential decision problem. LACE-RL uses deep reinforcement learning to dynamically tune keep-alive durations, jointly modeling cold-start probability, function-specific latency costs, and real-time carbon intensity. Using the Huawei Public Cloud Trace, we show that LACE-RL reduces cold starts by 51.69% and idle keep-alive carbon emissions by 77.08% compared to Huawei's static policy, while achieving better latency-carbon trade-offs than state-of-the-art heuristic and single-objective baselines, approaching Oracle performance.

📄 PDF Abstract BibTeX arXiv:2602.23935

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Transformer-Based Model for Cold Start Mitigation in FaaS Architecture

2025-04-15 · Alexandre Savi Fayam Mbala Mouen, Jerry Lacmou Zeutouo, Vianney Kengne Tchendji

Serverless architectures, particularly the Function as a Service (FaaS) model, have become a cornerstone of modern cloud computing due to their ability to simplify resource management and enhance application deployment a…

Cloud ComputingManagement

Adaptive Serverless Resource Management via Slot-Survival Prediction and Event-Driven Lifecycle Control

2026-04-07 · Zeyu Wang, Cuiqianhe Du, Renyue Zhang, Kejian Tong 외 arxiv

Serverless computing eliminates infrastructure management overhead but introduces significant challenges regarding cold start latency and resource utilization. Traditional static resource allocation often leads to ineffi…

The Model Parking Tax: Quantifying the Hidden Energy Cost of Always-On GPU Model Deployment

2026-04-15 · Sai Sathvik Vadari arxiv

The AI inference industry keeps models loaded in GPU memory around the clock to avoid cold-start latency, implicitly treating idle power as a fixed cost of readiness. Yet the structure of this cost has never been empiric…

Shallow AutoEncoding Recommender with Cold Start Handling via Side Features

2025-04-03 · Edward DongBo Cui, Lu Zhang, William Ping-hsun Lee

User and item cold starts present significant challenges in industrial applications of recommendation systems. Supplementing user-item interaction data with metadata is a common solution-but often at the cost of introduc…

Collaborative FilteringRecommendation Systems

On-demand Cold Start Frequency Reduction with Off-Policy Reinforcement Learning in Serverless Computing

2023-08-15 · Siddharth Agarwal, Maria A. Rodriguez, Rajkumar Buyya

Function-as-a-Service (FaaS) is a cloud computing paradigm offering an event-driven execution model to applications. It features serverless attributes by eliminating resource management responsibilities from developers, …

Cloud ComputingCPUManagementQ-Learning+2