paper-with-me

홈 › Papers

ProtoBandit: Efficient Prototype Selection via Multi-Armed Bandits

2022-10-04 · Arghya Roy Chaudhuri, Pratik Jawanpuria, Bamdev Mishra

In this work, we propose a multi-armed bandit-based framework for identifying a compact set of informative data instances (i.e., the prototypes) from a source dataset $S$ that best represents a given target set $T$. Prototypical examples of a given dataset offer interpretable insights into the underlying data distribution and assist in example-based reasoning, thereby influencing every sphere of human decision-making. Current state-of-the-art prototype selection approaches require $O(|S||T|)$ similarity comparisons between source and target data points, which becomes prohibitively expensive for large-scale settings. We propose to mitigate this limitation by employing stochastic greedy search in the space of prototypical examples and multi-armed bandits for reducing the number of similarity comparisons. Our randomized algorithm, ProtoBandit, identifies a set of $k$ prototypes incurring $O(k^3|S|)$ similarity comparisons, which is independent of the size of the target set. An interesting outcome of our analysis is for the $k$-medoids clustering problem $T = S$ setting) in which we show that our algorithm ProtoBandit approximates the BUILD step solution of the partitioning around medoids (PAM) method in $O(k^3|S|)$ complexity. Empirically, we observe that ProtoBandit reduces the number of similarity computation calls by several orders of magnitudes ($100-1000$ times) while obtaining solutions similar in quality to those from state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2210.01860

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingMulti-Armed BanditsPrototype Selection

Similar Papers 제목 키워드 기반

Risk averse non-stationary multi-armed bandits

2021-09-28 · Leo Benac, Frédéric Godin

This paper tackles the risk averse multi-armed bandits problem when incurred losses are non-stationary. The conditional value-at-risk (CVaR) is used as the objective function. Two estimation methods are proposed for this…

Multi-Armed Bandits

OSOM: A simultaneously optimal algorithm for multi-armed and linear contextual bandits

2019-05-24 · Niladri S. Chatterji, Vidya Muthukumar, Peter L. Bartlett

We consider the stochastic linear (multi-armed) contextual bandit problem with the possibility of hidden simple multi-armed bandit structure in which the rewards are independent of the contextual information. Algorithms …

Multi-Armed Bandits

Autonomous Drug Design with Multi-Armed Bandits

2022-07-04 · Hampus Gummesson Svensson, Esben Jannik Bjerrum, Christian Tyrchan, Ola Engkvist 외

Recent developments in artificial intelligence and automation support a new drug design paradigm: autonomous drug design. Under this paradigm, generative models can provide suggestions on thousands of molecules with spec…

Drug DesignMulti-Armed Bandits

Diversity-Driven Selection of Exploration Strategies in Multi-Armed Bandits

2018-08-23 · Fabien C. Y. Benureau, Pierre-Yves Oudeyer

We consider a scenario where an agent has multiple available strategies to explore an unknown environment. For each new interaction with the environment, the agent must select which exploration strategy to use. We provid…

DiversityMulti-Armed Bandits

Stacked Thompson Bandits

2017-02-28 · Lenz Belzner, Thomas Gabor

We introduce Stacked Thompson Bandits (STB) for efficiently generating plans that are likely to satisfy a given bounded temporal logic requirement. STB uses a simulation for evaluation of plans, and takes a Bayesian appr…

Thompson Sampling