Testing the Robustness of AutoML Systems
Automated machine learning (AutoML) systems aim at finding the best machine learning (ML) pipeline that automatically matches the task and data at hand. We investigate the robustness of machine learning pipelines generated with three AutoML systems, TPOT, H2O, and AutoKeras. In particular, we study the influence of dirty data on accuracy, and consider how using dirty training data may help create more robust solutions. Furthermore, we also analyze how the structure of the generated pipelines differs in different cases.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLBIG-bench Machine LearningSimilar Papers 제목 키워드 기반
Robusta: Robust AutoML for Feature Selection via Reinforcement Learning
Several AutoML approaches have been proposed to automate the machine learning (ML) process, such as searching for the ML model architectures and hyper-parameters. However, these AutoML pipelines only focus on improving t…
AutoMLFeature Importancefeature selectionreinforcement-learning+2AutoML Two-Sample Test
Two-sample tests are important in statistics and machine learning, both as tools for scientific discovery as well as to detect distribution shifts. This led to the development of many sophisticated test procedures going …
AutoMLscientific discoveryTwo-sample testingVocal Bursts Valence PredictionMining Robust Default Configurations for Resource-constrained AutoML
Automatic machine learning (AutoML) is a key enabler of the mass deployment of the next generation of machine learning systems. A key desideratum for future ML systems is the automatic selection of models and hyperparame…
AutoMLBIG-bench Machine LearningAutomated Imbalanced Learning
Automated Machine Learning has grown very successful in automating the time-consuming, iterative tasks of machine learning model development. However, current methods struggle when the data is imbalanced. Since many real…
AutoMLDREAM: Debugging and Repairing AutoML Pipelines
Deep Learning models have become an integrated component of modern software systems. In response to the challenge of model design, researchers proposed Automated Machine Learning (AutoML) systems, which automatically sea…
AutoML