paper-with-me

Papers

Bandit Multi-linear DR-Submodular Maximization and Its Applications on Adversarial Submodular Bandits

2023-05-21 · Zongqi Wan, Jialin Zhang, Wei Chen, Xiaoming Sun, Zhijie Zhang

We investigate the online bandit learning of the monotone multi-linear DR-submodular functions, designing the algorithm $\mathtt{BanditMLSM}$ that attains $O(T^{2/3}\log T)$ of $(1-1/e)$-regret. Then we reduce submodular bandit with partition matroid constraint and bandit sequential monotone maximization to the online bandit learning of the monotone multi-linear DR-submodular functions, attaining $O(T^{2/3}\log T)$ of $(1-1/e)$-regret in both problems, which improve the existing results. To the best of our knowledge, we are the first to give a sublinear regret algorithm for the submodular bandit with partition matroid constraint. A special case of this problem is studied by Streeter et al.(2009). They prove a $O(T^{4/5})$ $(1-1/e)$-regret upper bound. For the bandit sequential submodular maximization, the existing work proves an $O(T^{2/3})$ regret with a suboptimal $1/2$ approximation ratio (Niazadeh et al. 2021).

📄 PDF Abstract BibTeX arXiv:2305.12402

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Linear Submodular Maximization with Bandit Feedback

2024-07-02 · Wenjing Chen, Victoria G. Crawford

Submodular optimization with bandit feedback has recently been studied in a variety of contexts. In a number of real-world applications such as diversified recommender systems and data summarization, the submodular funct…

Data SummarizationRecommendation Systems

From Linear to Linearizable Optimization: A Novel Framework with Applications to Stationary and Non-stationary DR-submodular Optimization

2024-04-27 · Mohammad Pedramfar, Vaneet Aggarwal

This paper introduces the notion of upper-linearizable/quadratizable functions, a class that extends concavity and DR-submodularity in various settings, including monotone and non-monotone cases over different convex set…

Online Learning for Non-monotone Submodular Maximization: From Full Information to Bandit Feedback

2022-08-16 · Qixin Zhang, Zengde Deng, Zaiyi Chen, Kuangqi Zhou 외

In this paper, we revisit the online non-monotone continuous DR-submodular maximization problem over a down-closed convex set, which finds wide real-world applications in the domain of machine learning, economics, and op…

A Framework for Adapting Offline Algorithms to Solve Combinatorial Multi-Armed Bandit Problems with Bandit Feedback

2023-01-30 · Guanyu Nie, Yididiya Y Nadew, Yanhui Zhu, Vaneet Aggarwal 외

We investigate the problem of stochastic, combinatorial multi-armed bandits where the learner only has access to bandit feedback and the reward function can be non-linear. We provide a general framework for adapting disc…

Multi-Armed Bandits

Online Continuous Submodular Maximization: From Full-Information to Bandit Feedback

2019-10-28 · NeurIPS 2019 12 · Mingrui Zhang, Lin Chen, Hamed Hassani, Amin Karbasi

In this paper, we propose three online algorithms for submodular maximisation. The first one, Mono-Frank-Wolfe, reduces the number of per-function gradient evaluations from $T^{1/2}$ [Chen2018Online] and $T^{3/2}$ [chen2…