paper-with-me

Papers

Improved Projection-free Online Continuous Submodular Maximization

2023-05-29 · Yucheng Liao, Yuanyu Wan, Chang Yao, Mingli Song

We investigate the problem of online learning with monotone and continuous DR-submodular reward functions, which has received great attention recently. To efficiently handle this problem, especially in the case with complicated decision sets, previous studies have proposed an efficient projection-free algorithm called Mono-Frank-Wolfe (Mono-FW) using $O(T)$ gradient evaluations and linear optimization steps in total. However, it only attains a $(1-1/e)$-regret bound of $O(T^{4/5})$. In this paper, we propose an improved projection-free algorithm, namely POBGA, which reduces the regret bound to $O(T^{3/4})$ while keeping the same computational complexity as Mono-FW. Instead of modifying Mono-FW, our key idea is to make a novel combination of a projection-based algorithm called online boosting gradient ascent, an infeasible projection technique, and a blocking technique. Furthermore, we consider the decentralized setting and develop a variant of POBGA, which not only reduces the current best regret bound of efficient projection-free algorithms for this setting from $O(T^{4/5})$ to $O(T^{3/4})$, but also reduces the total communication complexity from $O(T)$ to $O(\sqrt{T})$.

📄 PDF Abstract BibTeX arXiv:2305.18442

Code (0)

등록된 구현이 없습니다.

Tasks

Blocking

Similar Papers 제목 키워드 기반

Projection-Free Online Optimization with Stochastic Gradient: From Convexity to Submodularity

2018-02-22 · ICML 2018 7 · Lin Chen, Christopher Harshaw, Hamed Hassani, Amin Karbasi

Online optimization has been a successful framework for solving large-scale problems under computational constraints and partial information. Current methods for online convex optimization require either a projection or …

Improved Approximate Regret for Decentralized Online Continuous Submodular Maximization via Reductions

2026-02-10 · Yuanyu Wan, Yu Shen, Dingzhi Yu, Bo Xue 외 arxiv

To expand the applicability of decentralized online learning, previous studies have proposed several algorithms for decentralized online continuous submodular maximization (D-OCSM) -- a non-convex/non-concave setting wit…

Communication-Efficient Decentralized Online Continuous DR-Submodular Maximization

2022-08-18 · Qixin Zhang, Zengde Deng, Xiangru Jian, Zaiyi Chen 외

Maximizing a monotone submodular function is a fundamental task in machine learning, economics, and statistics. In this paper, we present two communication-efficient decentralized online algorithms for the monotone conti…

Scalable Projection-Free Optimization

2021-05-07 · Mingrui Zhang

As a projection-free algorithm, Frank-Wolfe (FW) method, also known as conditional gradient, has recently received considerable attention in the machine learning community. In this dissertation, we study several topics o…

Stochastic Optimization

Online Continuous Submodular Maximization: From Full-Information to Bandit Feedback

2019-10-28 · NeurIPS 2019 12 · Mingrui Zhang, Lin Chen, Hamed Hassani, Amin Karbasi

In this paper, we propose three online algorithms for submodular maximisation. The first one, Mono-Frank-Wolfe, reduces the number of per-function gradient evaluations from $T^{1/2}$ [Chen2018Online] and $T^{3/2}$ [chen2…