paper-with-me

홈 › Papers

Oracle-Efficient Smoothed Online Learning for Piecewise Continuous Decision Making

2023-02-10 · Adam Block, Alexander Rakhlin, Max Simchowitz

Smoothed online learning has emerged as a popular framework to mitigate the substantial loss in statistical and computational complexity that arises when one moves from classical to adversarial learning. Unfortunately, for some spaces, it has been shown that efficient algorithms suffer an exponentially worse regret than that which is minimax optimal, even when the learner has access to an optimization oracle over the space. To mitigate that exponential dependence, this work introduces a new notion of complexity, the generalized bracketing numbers, which marries constraints on the adversary to the size of the space, and shows that an instantiation of Follow-the-Perturbed-Leader can attain low regret with the number of calls to the optimization oracle scaling optimally with respect to average regret. We then instantiate our bounds in several problems of interest, including online prediction and planning of piecewise continuous functions, which has many applications in fields as diverse as econometrics and robotics.

📄 PDF Abstract BibTeX arXiv:2302.05430

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingEconometrics

Similar Papers 제목 키워드 기반

Online Optimization of Smoothed Piecewise Constant Functions

2016-04-07 · Vincent Cohen-Addad, Varun Kanade

We study online optimization of smoothed piecewise constant functions over the domain [0, 1). This is motivated by the problem of adaptively picking parameters of learning algorithms as in the recently introduced framewo…

Smoothed Online Learning for Prediction in Piecewise Affine Systems

2023-01-26 · NeurIPS 2023 11 · Adam Block, Max Simchowitz, Russ Tedrake

The problem of piecewise affine (PWA) regression and planning is of foundational importance to the study of online learning, control, and robotics, where it provides a theoretically and empirically tractable setting to s…

Prediction

Oracle-Efficient Online Learning for Beyond Worst-Case Adversaries

2022-02-17 · Nika Haghtalab, Yanjun Han, Abhishek Shetty, Kunhe Yang

In this paper, we study oracle-efficient algorithms for beyond worst-case analysis of online learning. We focus on two settings. First, the smoothed analysis setting of [RST11,HRS22] where an adversary is constrained to …

Transductive Learning

Smoothed Analysis with Adaptive Adversaries

2021-02-16 · Nika Haghtalab, Tim Roughgarden, Abhishek Shetty

We prove novel algorithmic guarantees for several online problems in the smoothed analysis model. In this model, at each time an adversary chooses an input distribution with density function bounded above by $\tfrac{1}{\…

Efficient and Near-Optimal Smoothed Online Learning for Generalized Linear Functions

2022-05-25 · Adam Block, Max Simchowitz

Due to the drastic gap in complexity between sequential and batch statistical learning, recent work has studied a smoothed sequential learning setting, where Nature is constrained to select contexts with density bounded …