paper-with-me

홈 › Papers

What can multi-cloud configuration learn from AutoML?

2021-09-29 · Malgorzata Lazuka, Thomas Parnell, Andreea Anghel, Haralampos Pozidis

Multi-cloud computing has become increasingly popular with enterprises looking to avoid vendor lock-in. While most cloud providers offer similar functionality, they may differ significantly in terms of performance and/or cost. A customer looking to benefit from such differences will naturally want to solve the multi-cloud configuration problem: given a workload, which cloud provider should be chosen and how should its nodes be configured in order to minimize runtime or cost? In this work, we consider this multi-cloud optimization problem and publish a new offline benchmark dataset, MOCCA, comprising 60 different multi-cloud configuration tasks across 3 public cloud providers, to enable further research in this area. Furthermore, we identify an analogy between multi-cloud configuration and the selection-configuration problems that are commonly studied in the automated machine learning (AutoML) field. Inspired by this connection, we propose an algorithm for solving multi-cloud configuration, CloudBandit (CB). It treats the outer problem of cloud provider selection as a best-arm identification problem, in which each arm pull corresponds to running an arbitrary black-box optimizer on the inner problem of node configuration. Extensive experiments on MOCCA indicate that CB achieves (a) significantly lower regret relative to its component black-box optimizers and (b) competitive or lower regret relative to state-of-the-art AutoML methods, whilst also being cheaper and faster.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

AutoMLCloud Computing

Similar Papers 제목 키워드 기반

Search-based Methods for Multi-Cloud Configuration

2022-04-20 · Małgorzata Łazuka, Thomas Parnell, Andreea Anghel, Haralampos Pozidis

Multi-cloud computing has become increasingly popular with enterprises looking to avoid vendor lock-in. While most cloud providers offer similar functionality, they may differ significantly in terms of performance and/or…

AutoMLCloud Computing

Towards Green Automated Machine Learning: Status Quo and Future Directions

2021-11-10 · Tanja Tornede, Alexander Tornede, Jonas Hanselle, Marcel Wever 외

Automated machine learning (AutoML) strives for the automatic configuration of machine learning algorithms and their composition into an overall (software) solution - a machine learning pipeline - tailored to the learnin…

AutoMLBIG-bench Machine Learning

Gradients: When Markets Meet Fine-tuning -- A Distributed Approach to Model Optimisation

2025-06-09 · Christopher Subia-Waud

Foundation model fine-tuning faces a fundamental challenge: existing AutoML platforms rely on single optimisation strategies that explore only a fraction of viable hyperparameter configurations. In this white paper, We i…

AutoML

AutoML in Heavily Constrained Applications

2023-06-29 · Felix Neutatz, Marius Lindauer, Ziawasch Abedjan

Optimizing a machine learning pipeline for a task at hand requires careful configuration of various hyperparameters, typically supported by an AutoML system that optimizes the hyperparameters for the given training datas…

AutoMLMeta-Learning

Mining Robust Default Configurations for Resource-constrained AutoML

2022-02-20 · Moe Kayali, Chi Wang

Automatic machine learning (AutoML) is a key enabler of the mass deployment of the next generation of machine learning systems. A key desideratum for future ML systems is the automatic selection of models and hyperparame…

AutoMLBIG-bench Machine Learning