paper-with-me

Papers

Characterizing serverless platforms with serverlessbench

2020-10-12 · SOCC 2020 10 · Tianyi Yu, Qingyuan Liu, Dong Du, Yubin Xia, Bingyu Zang, Haibo Chen

Serverless computing promises auto-scalability and cost-efficiency (in "pay-as-you-go" manner) for high-productive software development. Because of its virtue, serverless computing has motivated increasingly new applications and services in the cloud. This, however, also presents new challenges including how to efficiently design high-performance serverless platforms and how to efficiently program on the platforms. This paper proposes ServerlessBench, an open-source benchmark suite for characterizing serverless platforms. It includes test cases exploring characteristic metrics of serverless computing, e.g., communication efficiency, startup latency, stateless overhead, and performance isolation. We have applied the benchmark suite to evaluate the most popular serverless computing platforms, including AWS Lambda, Open-Whisk, and Fn, and present new serverless implications from the study. For example, we show scenarios where decoupling an application into a composition of serverless functions can be beneficial in cost-saving and performance, and that the "stateless" property in serverless computing can hurt the execution performance of serverless functions. These implications form several design guidelines, which may help platform designers to optimize serverless platforms and application developers to design their functions best fit to the platforms.

📄 PDF Abstract BibTeX

Code (1)

SJTU-IPADS/ServerlessBench

Similar Papers 제목 키워드 기반

Performance Modeling of Metric-Based Serverless Computing Platforms

2022-02-23 · Nima Mahmoudi, Hamzeh Khazaei

Analytical performance models are very effective in ensuring the quality of service and cost of service deployment remain desirable under different conditions and workloads. While various analytical performance models ha…

Cloud Computing

ServerlessT2I: Efficient Text-to-Image Workflow Serving on a Serverless Platform

2026-07-29 · Xiaoxiao Jiang, Suyi Li, Sheng Yao, Tianyu Feng 외 arxiv

Text-to-image (T2I) workflows are increasingly deployed on serverless platforms because users often compose customized workflows and invoke them intermittently. Existing platforms typically deploy each workflow as an opa…

MLProxy: SLA-Aware Reverse Proxy for Machine Learning Inference Serving on Serverless Computing Platforms

2022-02-23 · Nima Mahmoudi, Hamzeh Khazaei

Serving machine learning inference workloads on the cloud is still a challenging task on the production level. Optimal configuration of the inference workload to meet SLA requirements while optimizing the infrastructure …

BIG-bench Machine LearningManagement

How Does It Function? Characterizing Long-term Trends in Production Serverless Workloads

2023-12-15 · Artjom Joosen, Ahmed Hassan, Martin Asenov, Rajkarn Singh 외

This paper releases and analyzes two new Huawei cloud serverless traces. The traces span a period of over 7 months with over 1.4 trillion function invocations combined. The first trace is derived from Huawei's internal w…

DiversitySchedulingTime Series Prediction

Reinforcement Learning-Based Dynamic Management of Structured Parallel Farm Skeletons on Serverless Platforms

2026-02-06 · Lanpei Li, Massimo Coppola, Malio Li, Valerio Besozzi 외 arxiv

We present a framework for dynamic management of structured parallel processing skeletons on serverless platforms. Our goal is to bring HPC-like performance and resilience to serverless and continuum environments while p…

Reinforcement Learning