Open Problem: Model Selection for Contextual Bandits
In statistical learning, algorithms for model selection allow the learner to adapt to the complexity of the best hypothesis class in a sequence. We ask whether similar guarantees are possible for contextual bandit learning.
Code (0)
등록된 구현이 없습니다.
Tasks
modelModel SelectionMulti-Armed BanditsSimilar Papers 제목 키워드 기반
The Pareto Frontier of model selection for general Contextual Bandits
Recent progress in model selection raises the question of the fundamental limits of these techniques. Under specific scrutiny has been model selection for general contextual bandits with nested policy classes, resulting …
Model SelectionMulti-Armed BanditsUniversal and data-adaptive algorithms for model selection in linear contextual bandits
Model selection in contextual bandits is an important complementary problem to regret minimization with respect to a fixed model class. We consider the simplest non-trivial instance of model-selection: distinguishing a s…
DiversityModel SelectionMulti-Armed BanditsModel selection for contextual bandits
We introduce the problem of model selection for contextual bandits, where a learner must adapt to the complexity of the optimal policy while balancing exploration and exploitation. Our main result is a new model selectio…
modelModel SelectionMulti-Armed BanditsDynamic Batch Learning in High-Dimensional Sparse Linear Contextual Bandits
We study the problem of dynamic batch learning in high-dimensional sparse linear contextual bandits, where a decision maker, under a given maximum-number-of-batch constraint and only able to observe rewards at the end of…
Decision MakingMarketingMulti-Armed BanditsVocal Bursts Intensity PredictionContexts can be Cheap: Solving Stochastic Contextual Bandits with Linear Bandit Algorithms
In this paper, we address the stochastic contextual linear bandit problem, where a decision maker is provided a context (a random set of actions drawn from a distribution). The expected reward of each action is specified…
Multi-Armed Bandits