ATM: A distributed, collaborative, scalable system for automated machine learning
In this paper, we present Auto-Tuned Models, or ATM, a distributed, collaborative, scalable system for automated machine learning. Users of ATM can simply upload a dataset, choose a subset of modeling methods, and choose to use ATM’s hybrid Bayesian and multi-armed bandit optimization system. The distributed system works in a load balanced fashion to quickly deliver results in the form of ready-to-predict models, confusion matrices, cross-validation results, and training timings. By automating hyperparameter tuning and model selection, ATM returns the emphasis of the machine learning workflow to its most irreducible part: feature engineering. We demonstrate the usefulness of ATM on 420 datasets from OpenML and train over 3 million classifiers. Our initial results show ATM can beat human-generated solutions for 30% of the datasets, and can do so in 1/100th of the time.
Code (2)
Tasks
AutoMLBIG-bench Machine LearningFeature EngineeringHyperparameter OptimizationModel SelectionSimilar Papers 제목 키워드 기반
Opportunities of Federated Learning in Connected, Cooperative and Automated Industrial Systems
Next-generation autonomous and networked industrial systems (i.e., robots, vehicles, drones) have driven advances in ultra-reliable, low latency communications (URLLC) and computing. These networked multi-agent systems r…
Federated LearningAutoSlicer: Scalable Automated Data Slicing for ML Model Analysis
Automated slicing aims to identify subsets of evaluation data where a trained model performs anomalously. This is an important problem for machine learning pipelines in production since it plays a key role in model debug…
FairnessScale-free Non-collaborative Linear Protocol Design for A Class of Homogeneous Multi-agent Systems
In this paper, we have focused on identifying a class of continuous- and discrete-time MAS for which a scale-free non-collaborative (i.e., scale-free fully distributed) linear protocol design is developed. We have identi…
Collaborative Distributed Machine Learning
Various collaborative distributed machine learning (CDML) systems, including federated learning systems and swarm learning systems, with diferent key traits were developed to leverage resources for the development and us…
Federated LearningLow Altitude 3-D Coverage Performance Analysis in Cell-Free Distributed Collaborative Massive MIMO Systems
To improve the poor performance of distributed operation and non-scalability of centralized operation in traditional cell-free massive MIMO, we propose a cell-free distributed collaborative (CFDC) massive multiple-input …