paper-with-me

홈 › Papers

Online Learning with Low Rank Experts

2016-03-21 · Elad Hazan, Tomer Koren, Roi Livni, Yishay Mansour

We consider the problem of prediction with expert advice when the losses of the experts have low-dimensional structure: they are restricted to an unknown $d$-dimensional subspace. We devise algorithms with regret bounds that are independent of the number of experts and depend only on the rank $d$. For the stochastic model we show a tight bound of $\Theta(\sqrt{dT})$, and extend it to a setting of an approximate $d$ subspace. For the adversarial model we show an upper bound of $O(d\sqrt{T})$ and a lower bound of $\Omega(\sqrt{dT})$.

📄 PDF Abstract BibTeX arXiv:1603.06352

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Affine-Invariant Online Optimization and the Low-rank Experts Problem

2017-12-01 · NeurIPS 2017 12 · Tomer Koren, Roi Livni

We present a new affine-invariant optimization algorithm called Online Lazy Newton. The regret of Online Lazy Newton is independent of conditioning: the algorithm's performance depends on the best possible preconditionin…

Online Learning with Many Experts

2017-02-25 · Alon Cohen, Shie Mannor

We study the problem of prediction with expert advice when the number of experts in question may be extremely large or even infinite. We devise an algorithm that obtains a tight regret bound of $\widetilde{O}(\epsilon T …

Dying Experts: Efficient Algorithms with Optimal Regret Bounds

2019-10-29 · NeurIPS 2019 12 · Hamid Shayestehmanesh, Sajjad Azami, Nishant A. Mehta

We study a variant of decision-theoretic online learning in which the set of experts that are available to Learner can shrink over time. This is a restricted version of the well-studied sleeping experts problem, itself a…

Policy Regret for Embedding Model Routing: Contextual Bandits with Low-Rank Experts

2026-06-12 · Yan Dai, Negin Golrezaei, Patrick Jaillet arxiv

Modern recommendation systems increasingly rely on dynamically routing diverse queries to multiple embedding models. Despite its practical significance, this problem remains poorly understood under realistic conditions l…

Recommendation Systems

No-Regret Online Prediction with Strategic Experts

2023-05-24 · NeurIPS 2023 11

We study a generalization of the online binary prediction with expert advice framework where at each round, the learner is allowed to pick $m\geq 1$ experts from a pool of $K$ experts and the overall utility is a modular…

Prediction