Transformer-Based Model for Cold Start Mitigation in FaaS Architecture

2025-04-15 · Alexandre Savi Fayam Mbala Mouen, Jerry Lacmou Zeutouo, Vianney Kengne Tchendji

Serverless architectures, particularly the Function as a Service (FaaS) model, have become a cornerstone of modern cloud computing due to their ability to simplify resource management and enhance application deployment agility. However, a significant challenge remains: the cold start problem. This phenomenon occurs when an idle FaaS function is invoked, requiring a full initialization process, which increases latency and degrades user experience. Existing solutions for cold start mitigation are limited in terms of invocation pattern generalization and implementation complexity. In this study, we propose an innovative approach leveraging Transformer models to mitigate the impact of cold starts in FaaS architectures. Our solution excels in accurately modeling function initialization delays and optimizing serverless system performance. Experimental evaluation using a public dataset provided by Azure demonstrates a significant reduction in cold start times, reaching up to 79\% compared to conventional methods.

📄 PDF Abstract BibTeX arXiv:2504.11338

Code (0)

등록된 구현이 없습니다.

Tasks

Cloud ComputingManagement

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Position-Wise Feed-Forward Layer 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Residual Connection 설명 없음

On-demand Cold Start Frequency Reduction with Off-Policy Reinforcement Learning in Serverless Computing

2023-08-15 · Siddharth Agarwal, Maria A. Rodriguez, Rajkumar Buyya

Function-as-a-Service (FaaS) is a cloud computing paradigm offering an event-driven execution model to applications. It features serverless attributes by eliminating resource management responsibilities from developers, …

Cloud Computing CPU Management Q-Learning+2

Architectural Implications of Function-as-a-Service Computing

2019-10-16 · Shahrad, Mohammad; Fonseca, Rodrigo; Goiri, Íñigo; Irfan Chaudhry 외

Serverless computing is a rapidly growing cloud application model, popularized by Amazon’s Lambda platform. Serverless cloud services provide fine-grained provisioning of resources, which scale automatically with user de…

Enabling Efficient Serverless Inference Serving for LLM (Large Language Model) in the Cloud

2024-11-23 · Himel Ghosh

This review report discusses the cold start latency in serverless inference and existing solutions. It particularly reviews the ServerlessLLM method, a system designed to address the cold start problem in serverless infe…

GPU Language Modeling Language Modelling Large Language Model

How Does It Function? Characterizing Long-term Trends in Production Serverless Workloads

2023-12-15 · Artjom Joosen, Ahmed Hassan, Martin Asenov, Rajkarn Singh 외

This paper releases and analyzes two new Huawei cloud serverless traces. The traces span a period of over 7 months with over 1.4 trillion function invocations combined. The first trace is derived from Huawei's internal w…

Diversity Scheduling Time Series Prediction

A Multi-Strategy based Pre-Training Method for Cold-Start Recommendation

2021-12-04 · Bowen Hao, Hongzhi Yin, Jing Zhang, Cuiping Li 외

Cold-start problem is a fundamental challenge for recommendation tasks. The recent self-supervised learning (SSL) on Graph Neural Networks (GNNs) model, PT-GNN, pre-trains the GNN model to reconstruct the cold-start embe…

Contrastive Learning Meta-Learning Self-Supervised Learning