paper-with-me

홈 › Papers

Sequential Automated Machine Learning: Bandits-driven Exploration using a Collaborative Filtering Representation

2021-05-20 · ICML Workshop AutoML 2021 7 · Maxime Heuillet, Benoit Debaque, Audrey Durand

The goal of Automated Machine Learning (AutoML) is to make Machine Learning (ML) tools more accessible. Collaborative Filtering (CF) methods have shown great success in automating the creation of machine learning pipelines. In this work, we frame the AutoML problem under a sequential setting where datasets arrive one at a time. On each dataset, an agent can try a small number of pipelines (exploration) before recommending a pipeline for this dataset (recommendation). The goal is to maximize the performance of the recommended pipelines over the sequence of datasets. More specifically, we focus on the exploration policy used for selecting the pipelines to explore before making the recommendation. We propose an approach based on the LinUCB bandit algorithm that leverages the latent representations extracted from matrix factorization (MF). We show that the exploration policy impacts the recommendation performance and that MF-based latent representations are more useful for exploration than for recommendation.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

AutoMLBIG-bench Machine LearningCollaborative Filtering

Similar Papers 제목 키워드 기반

Value Directed Exploration in Multi-Armed Bandits with Structured Priors

2017-04-12 · Bence Cserna, Marek Petrik, Reazul Hasan Russel, Wheeler Ruml

Multi-armed bandits are a quintessential machine learning problem requiring the balancing of exploration and exploitation. While there has been progress in developing algorithms with strong theoretical guarantees, there …

Multi-Armed Bandits

Parameterized Exploration

2019-07-13 · Jesse Clifton, Lili Wu, Eric Laber

We introduce Parameterized Exploration (PE), a simple family of methods for model-based tuning of the exploration schedule in sequential decision problems. Unlike common heuristics for exploration, our method accounts fo…

Multi-Armed Bandits

Deep Contextual Multi-armed Bandits

2018-07-25 · Mark Collier, Hector Urdiales Llorens

Contextual multi-armed bandit problems arise frequently in important industrial applications. Existing solutions model the context either linearly, which enables uncertainty driven (principled) exploration, or non-linear…

MarketingMulti-Armed BanditsThompson Sampling

Markov Decision Process modeled with Bandits for Sequential Decision Making in Linear-flow

2021-07-01 · Wenjun Zeng, Yi Liu

For marketing, we sometimes need to recommend content for multiple pages in sequence. Different from general sequential decision making process, the use cases have a simpler flow where customers per seeing recommended co…

Decision MakingMarketingQ-LearningSequential Decision Making+1

A Classification View on Meta Learning Bandits

2025-04-06 · Mirco Mutti, Jeongyeol Kwon, Shie Mannor, Aviv Tamar

Contextual multi-armed bandits are a popular choice to model sequential decision-making. E.g., in a healthcare application we may perform various tests to asses a patient condition (exploration) and then decide on the be…

ClassificationMeta-LearningMulti-Armed BanditsSequential Decision Making