paper-with-me

홈 › Papers

Amazon SageMaker Autopilot: a white box AutoML solution at scale

2020-12-15 · Piali Das, Valerio Perrone, Nikita Ivkin, Tanya Bansal, Zohar Karnin, Huibin Shen, Iaroslav Shcherbatyi, Yotam Elor, Wilton Wu, Aida Zolic, Thibaut Lienart, Alex Tang, Amr Ahmed, Jean Baptiste Faddoul, Rodolphe Jenatton, Fela Winkelmolen, Philip Gautier, Leo Dirac, Andre Perunicic, Miroslav Miladinovic, Giovanni Zappella, Cédric Archambeau, Matthias Seeger, Bhaskar Dutt, Laurence Rouesnel

AutoML systems provide a black-box solution to machine learning problems by selecting the right way of processing features, choosing an algorithm and tuning the hyperparameters of the entire pipeline. Although these systems perform well on many datasets, there is still a non-negligible number of datasets for which the one-shot solution produced by each particular system would provide sub-par performance. In this paper, we present Amazon SageMaker Autopilot: a fully managed system providing an automated ML solution that can be modified when needed. Given a tabular dataset and the target column name, Autopilot identifies the problem type, analyzes the data and produces a diverse set of complete ML pipelines including feature preprocessing and ML algorithms, which are tuned to generate a leaderboard of candidate models. In the scenario where the performance is not satisfactory, a data scientist is able to view and edit the proposed ML pipelines in order to infuse their expertise and business knowledge without having to revert to a fully manual solution. This paper describes the different components of Autopilot, emphasizing the infrastructure choices that allow scalability, high quality models, editable ML pipelines, consumption of artifacts of offline meta-learning, and a convenient integration with the entire SageMaker suite allowing these trained models to be used in a production setting.

📄 PDF Abstract BibTeX arXiv:2012.08483

Code (0)

등록된 구현이 없습니다.

Tasks

AutoMLMeta-Learning

Similar Papers 제목 키워드 기반

Optimal Pricing for Data-Augmented AutoML Marketplaces

2023-10-27 · Minbiao Han, Jonathan Light, Steven Xia, Sainyam Galhotra 외

Organizations often lack sufficient data to effectively train machine learning (ML) models, while others possess valuable data that remains underutilized. Data markets promise to unlock substantial value by matching data…

AutoMLFairnessModel Discovery

Amazon SageMaker Model Parallelism: A General and Flexible Framework for Large Model Training

2021-11-10 · Can Karakus, Rahul Huilgol, Fei Wu, Anirudh Subramanian 외

With deep learning models rapidly growing in size, systems-level solutions for large-model training are required. We present Amazon SageMaker model parallelism, a software library that integrates with PyTorch, and enable…

Collaborative Filteringmodel

Amazon SageMaker Clarify: Machine Learning Bias Detection and Explainability in the Cloud

2021-09-07 · Michaela Hardt, Xiaoguang Chen, Xiaoyi Cheng, Michele Donini 외

Understanding the predictions made by machine learning (ML) models and their potential biases remains a challenging and labor-intensive task that depends on the application, the dataset, and the specific model. We presen…

Bias DetectionBIG-bench Machine LearningFairnessFeature Importance

Amazon SageMaker Model Monitor: A System for Real-Time Insights into Deployed Machine Learning Models

2021-11-26 · David Nigenda, Zohar Karnin, Muhammad Bilal Zafar, Raghu Ramesha 외

With the increasing adoption of machine learning (ML) models and systems in high-stakes settings across different industries, guaranteeing a model's performance after deployment has become crucial. Monitoring models in p…

BIG-bench Machine Learning

Amazon SageMaker Automatic Model Tuning: Scalable Gradient-Free Optimization

2020-12-15 · Valerio Perrone, Huibin Shen, Aida Zolic, Iaroslav Shcherbatyi 외

Tuning complex machine learning systems is challenging. Machine learning typically requires to set hyperparameters, be it regularization, architecture, or optimization parameters, whose tuning is critical to achieve good…

Bayesian OptimizationBIG-bench Machine Learning