Interpret-able feedback for AutoML systems
Automated machine learning (AutoML) systems aim to enable training machine learning (ML) models for non-ML experts. A shortcoming of these systems is that when they fail to produce a model with high accuracy, the user has no path to improve the model other than hiring a data scientist or learning ML -- this defeats the purpose of AutoML and limits its adoption. We introduce an interpretable data feedback solution for AutoML. Our solution suggests new data points for the user to label (without requiring a pool of unlabeled data) to improve the model's accuracy. Our solution analyzes how features influence the prediction among all ML models in an AutoML ensemble, and we suggest more data samples from feature ranges that have high variance in such analysis. Our evaluation shows that our solution can improve the accuracy of AutoML by 7-8% and significantly outperforms popular active learning solutions in data efficiency, all the while providing the added benefit of being interpretable.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningAutoMLBIG-bench Machine LearningSimilar Papers 제목 키워드 기반
DREAM: Debugging and Repairing AutoML Pipelines
Deep Learning models have become an integrated component of modern software systems. In response to the challenge of model design, researchers proposed Automated Machine Learning (AutoML) systems, which automatically sea…
AutoMLUniAutoML: A Human-Centered Framework for Unified Discriminative and Generative AutoML with Large Language Models
Automated Machine Learning (AutoML) has simplified complex ML processes such as data pre-processing, model selection, and hyper-parameter searching. However, traditional AutoML frameworks focus solely on discriminative t…
AutoMLModel SelectionThe Potential of AutoML for Recommender Systems
Automated Machine Learning (AutoML) has greatly advanced applications of Machine Learning (ML) including model compression, machine translation, and computer vision. Recommender Systems (RecSys) can be seen as an applica…
AutoMLMachine TranslationModel CompressionRecommendation SystemsAutomatic Componentwise Boosting: An Interpretable AutoML System
In practice, machine learning (ML) workflows require various different steps, from data preprocessing, missing value imputation, model selection, to model tuning as well as model evaluation. Many of these steps rely on h…
AutoMLFeature ImportanceImputationModel SelectionStructured Agentic Workflows for Financial Time-Series Modeling with LLMs and Reflective Feedback
Time-series data is central to decision-making in financial markets, yet building high-performing, interpretable, and auditable models remains a major challenge. While Automated Machine Learning (AutoML) frameworks strea…
Synthetic Data GenerationCode Generation