paper-with-me

홈 › Papers

Chasing Convex Bodies and Functions with Black-Box Advice

2022-06-23 · Nicolas Christianson, Tinashe Handina, Adam Wierman

We consider the problem of convex function chasing with black-box advice, where an online decision-maker aims to minimize the total cost of making and switching between decisions in a normed vector space, aided by black-box advice such as the decisions of a machine-learned algorithm. The decision-maker seeks cost comparable to the advice when it performs well, known as $\textit{consistency}$, while also ensuring worst-case $\textit{robustness}$ even when the advice is adversarial. We first consider the common paradigm of algorithms that switch between the decisions of the advice and a competitive algorithm, showing that no algorithm in this class can improve upon 3-consistency while staying robust. We then propose two novel algorithms that bypass this limitation by exploiting the problem's convexity. The first, INTERP, achieves $(\sqrt{2}+\epsilon)$-consistency and $\mathcal{O}(\frac{C}{\epsilon^2})$-robustness for any $\epsilon > 0$, where $C$ is the competitive ratio of an algorithm for convex function chasing or a subclass thereof. The second, BDINTERP, achieves $(1+\epsilon)$-consistency and $\mathcal{O}(\frac{CD}{\epsilon})$-robustness when the problem has bounded diameter $D$. Further, we show that BDINTERP achieves near-optimal consistency-robustness trade-off for the special case where cost functions are $\alpha$-polyhedral.

📄 PDF Abstract BibTeX arXiv:2206.11780

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On the Adversarial Convex Body Chasing Problem

2022-09-27 · Yue Guan, Longxu Pan, Daigo Shishika, Panagiotis Tsiotras

In this work, we extend the convex bodies chasing problem (CBC) to an adversarial setting, where an agent (the Player) is tasked with chasing a sequence of convex bodies generated adversarially by another agent (the Oppo…

Online Multiserver Convex Chasing and Optimization

2020-04-15 · Sébastien Bubeck, Yuval Rabani, Mark Sellke

We introduce the problem of $k$-chasing of convex functions, a simultaneous generalization of both the famous k-server problem in $R^d$, and of the problem of chasing convex bodies and functions. Aside from fundamental i…

Clustering

Universal Online Convex Optimization with $1$ Projection per Round

2024-05-30 · Wenhao Yang, Yibo Wang, Peng Zhao, Lijun Zhang

To address the uncertainty in function types, recent progress in online convex optimization (OCO) has spurred the development of universal algorithms that simultaneously attain minimax rates for multiple types of convex …

Equipping Black-Box Policies with Model-Based Advice for Stable Nonlinear Control

2022-06-02 · Tongxin Li, Ruixiao Yang, Guannan Qu, Yiheng Lin 외

Machine-learned black-box policies are ubiquitous for nonlinear control problems. Meanwhile, crude model information is often available for these problems from, e.g., linear approximations of nonlinear dynamics. We study…

Beyond Black-Box Advice: Learning-Augmented Algorithms for MDPs with Q-Value Predictions

2023-07-20 · NeurIPS 2023 11

We study the tradeoff between consistency and robustness in the context of a single-trajectory time-varying Markov Decision Process (MDP) with untrusted machine-learned advice. Our work departs from the typical approach …