홈 › Papers

Learning meta-features for AutoML

2021-09-29 · ICLR 2022 4 · Herilalaina Rakotoarison, Louisot Milijaona, Andry Rasoanaivo, Michele Sebag, Marc Schoenauer

This paper tackles the AutoML problem, aimed to automatically select an ML algorithm and its hyper-parameter configuration most appropriate to the dataset at hand. The proposed approach, MetaBu, learns new meta-features via an Optimal Transport procedure, aligning the manually designed \mf s with the space of distributions on the hyper-parameter configurations. MetaBu meta-features, learned once and for all, induce a topology on the set of datasets that is exploited to define a distribution of promising hyper-parameter configurations amenable to AutoML. Experiments on the OpenML CC-18 benchmark demonstrate that using MetaBu meta-features boosts the performance of state of the art AutoML systems, AutoSklearn (Feurer et al. 2015) and Probabilistic Matrix Factorization (Fusi et al. 2018). Furthermore, the inspection of MetaBu meta-features gives some hints into when an ML algorithm does well. Finally, the topology based on MetaBu meta-features enables to estimate the intrinsic dimensionality of the OpenML benchmark w.r.t. a given ML algorithm or pipeline.

📄 PDF Abstract BibTeX

Code (1)

luxusg1/metabu 공식 구현 pytorch

Tasks

AutoML

Online Meta-learning for AutoML in Real-time (OnMAR)

2025-02-27 · Mia Gerber, Anna Sergeevna Bosman, Johan Pieter de Villiers

Automated machine learning (AutoML) is a research area focusing on using optimisation techniques to design machine learning (ML) algorithms, alleviating the need for a human to perform manual algorithm design. Real-time …

AutoML Image Clustering Meta-Learning Video Classification

A Scalable AutoML Approach Based on Graph Neural Networks

2021-10-29 · Mossad Helali, Essam Mansour, Ibrahim Abdelaziz, Julian Dolby 외

AutoML systems build machine learning models automatically by performing a search over valid data transformations and learners, along with hyper-parameter optimization for each learner. Many AutoML systems use meta-learn…

AutoML Graph Generation Meta-Learning valid

Considerations of automated machine learning in clinical metabolic profiling: Altered homocysteine plasma concentration associated with metformin exposure

2017-10-09 · Alena Orlenko, Jason H. Moore, Patryk Orzechowski, Randal S. Olson 외

With the maturation of metabolomics science and proliferation of biobanks, clinical metabolic profiling is an increasingly opportunistic frontier for advancing translational clinical research. Automated Machine Learning …

AutoML BIG-bench Machine Learning feature selection

Privileged Zero-Shot AutoML

2021-06-25 · Nikhil Singh, Brandon Kates, Jeff Mentch, Anant Kharkar 외

This work improves the quality of automated machine learning (AutoML) systems by using dataset and function descriptions while significantly decreasing computation time from minutes to milliseconds by using a zero-shot a…

AutoML BIG-bench Machine Learning Graph Neural Network Representation Learning

Problem-oriented AutoML in Clustering

2024-09-24 · Matheus Camilo da Silva, Gabriel Marques Tavares, Eric Medvet, Sylvio Barbon Junior

The Problem-oriented AutoML in Clustering (PoAC) framework introduces a novel, flexible approach to automating clustering tasks by addressing the shortcomings of traditional AutoML solutions. Conventional methods often r…

AutoML Clustering Data Visualization