paper-with-me

Papers

A Combinatorial Semi-Bandit Approach to Charging Station Selection for Electric Vehicles

2023-01-17 · Niklas Åkerblom, Morteza Haghir Chehreghani

In this work, we address the problem of long-distance navigation for battery electric vehicles (BEVs), where one or more charging sessions are required to reach the intended destination. We consider the availability and performance of the charging stations to be unknown and stochastic, and develop a combinatorial semi-bandit framework for exploring the road network to learn the parameters of the queue time and charging power distributions. Within this framework, we first outline a pre-processing for the road network graph to handle the constrained combinatorial optimization problem in an efficient way. Then, for the pre-processed graph, we use a Bayesian approach to model the stochastic edge weights, utilizing conjugate priors for the one-parameter exponential and two-parameter gamma distributions, the latter of which is novel to multi-armed bandit literature. Finally, we apply combinatorial versions of Thompson Sampling, BayesUCB and Epsilon-greedy to the problem. We demonstrate the performance of our framework on long-distance navigation problem instances in country-sized road networks, with simulation experiments in Norway, Sweden and Finland.

📄 PDF Abstract BibTeX arXiv:2301.07156

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial OptimizationThompson Sampling

Similar Papers 제목 키워드 기반

A Near-Optimal Change-Detection Based Algorithm for Piecewise-Stationary Combinatorial Semi-Bandits

2019-08-27 · Huozhi Zhou, Lingda Wang, Lav R. Varshney, Ee-Peng Lim

We investigate the piecewise-stationary combinatorial semi-bandit problem. Compared to the original combinatorial semi-bandit problem, our setting assumes the reward distributions of base arms may change in a piecewise-s…

Change DetectionMulti-Armed Bandits

Piecewise-Stationary Combinatorial Semi-Bandit with Causally Related Rewards

2023-07-26 · Behzad Nourani-Koliji, Steven Bilaj, Amir Rezaei Balef, Setareh Maghsudi

We study the piecewise stationary combinatorial semi-bandit problem with causally related rewards. In our nonstationary environment, variations in the base arms' distributions, causal relationships between rewards, or bo…

Decision Making

Combinatorial Semi-Bandits with Knapsacks

2017-05-23 · Karthik Abinav Sankararaman, Aleksandrs Slivkins

We unify two prominent lines of work on multi-armed bandits: bandits with knapsacks (BwK) and combinatorial semi-bandits. The former concerns limited "resources" consumed by the algorithm, e.g., limited supply in dynamic…

Multi-Armed Bandits

Non-stationary Delayed Combinatorial Semi-Bandit with Causally Related Rewards

2023-07-18 · Saeed Ghoorchian, Setareh Maghsudi

Sequential decision-making under uncertainty is often associated with long feedback delays. Such delays degrade the performance of the learning agent in identifying a subset of arms with the optimal collective reward in …

Decision MakingDecision Making Under UncertaintySequential Decision Making

Asymptotically Optimal Strategies For Combinatorial Semi-Bandits in Polynomial Time

2021-02-14 · Thibaut Cuvelier, Richard Combes, Eric Gourdin

We consider combinatorial semi-bandits with uncorrelated Gaussian rewards. In this article, we propose the first method, to the best of our knowledge, that enables to compute the solution of the Graves-Lai optimization p…