paper-with-me

Papers

Lévy walks derived from a Bayesian decision-making model in non-stationary environments

2020-12-16 · Shuji Shinohara, Nobuhito Manome, Yoshihiro Nakajima, Yukio Pegio Gunji, Toru Moriyama, Hiroshi Okamoto, Shunji Mitsuyoshi, Ung-il Chung

L\'evy walks are found in the migratory behaviour patterns of various organisms, and the reason for this phenomenon has been much discussed. We use simulations to demonstrate that learning causes the changes in confidence level during decision-making in non-stationary environments, and results in L\'evy-walk-like patterns. One inference algorithm involving confidence is Bayesian inference. We propose an algorithm that introduces the effects of learning and forgetting into Bayesian inference, and simulate an imitation game in which two decision-making agents incorporating the algorithm estimate each other's internal models from their opponent's observational data. For forgetting without learning, agent confidence levels remained low due to a lack of information on the counterpart and Brownian walks occurred for a wide range of forgetting rates. Conversely, when learning was introduced, high confidence levels occasionally occurred even at high forgetting rates, and Brownian walks universally became L\'evy walks through a mixture of high- and low-confidence states.

📄 PDF Abstract BibTeX arXiv:2012.08858

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferenceDecision Making

Similar Papers 제목 키워드 기반

Stationary distribution of node2vec random walks on household models

2025-02-26 · Lars Schroeder, Clara Stegehuis

The node2vec random walk has proven to be a key tool in network embedding algorithms. These random walks are tuneable, and their transition probabilities depend on the previous visited node and on the triangles containin…

Network Embedding

BOF-UCB: A Bayesian-Optimistic Frequentist Algorithm for Non-Stationary Contextual Bandits

2023-07-07 · Nicklas Werge, Abdullah Akgül, Melih Kandemir

We propose a novel Bayesian-Optimistic Frequentist Upper Confidence Bound (BOF-UCB) algorithm for stochastic contextual linear bandits in non-stationary environments. This unique combination of Bayesian and frequentist p…

Decision MakingMulti-Armed BanditsSequential Decision Making

Distributed Consensus Algorithm for Decision-Making in Multi-agent Multi-armed Bandit

2023-06-09 · Xiaotong Cheng, Setareh Maghsudi

We study a structured multi-agent multi-armed bandit (MAMAB) problem in a dynamic environment. A graph reflects the information-sharing structure among agents, and the arms' reward distributions are piecewise-stationary …

Change Point DetectionDecision Making

Sequential Monte Carlo Bandits

2018-08-08 · Iñigo Urteaga, Chris H. Wiggins

We extend Bayesian multi-armed bandit (MAB) algorithms beyond their original setting by making use of sequential Monte Carlo (SMC) methods. A MAB is a sequential decision making problem where the goal is to learn a polic…

Decision MakingSequential Decision MakingThompson Sampling

Online Calibrated and Conformal Prediction Improves Bayesian Optimization

2021-12-08 · Shachi Deshpande, Charles Marx, Volodymyr Kuleshov

Accurate uncertainty estimates are important in sequential model-based decision-making tasks such as Bayesian optimization. However, these estimates can be imperfect if the data violates assumptions made by the model (e.…

Bayesian OptimizationConformal PredictionDecision MakingHyperparameter Optimization+1