paper-with-me

Papers

Interactive Restless Multi-armed Bandit Game and Swarm Intelligence Effect

2015-03-13 · Shunsuke Yoshida, Masato Hisakado, Shintaro Mori

We obtain the conditions for the emergence of the swarm intelligence effect in an interactive game of restless multi-armed bandit (rMAB). A player competes with multiple agents. Each bandit has a payoff that changes with a probability $p_{c}$ per round. The agents and player choose one of three options: (1) Exploit (a good bandit), (2) Innovate (asocial learning for a good bandit among $n_{I}$ randomly chosen bandits), and (3) Observe (social learning for a good bandit). Each agent has two parameters $(c,p_{obs})$ to specify the decision: (i) $c$, the threshold value for Exploit, and (ii) $p_{obs}$, the probability for Observe in learning. The parameters $(c,p_{obs})$ are uniformly distributed. We determine the optimal strategies for the player using complete knowledge about the rMAB. We show whether or not social or asocial learning is more optimal in the $(p_{c},n_{I})$ space and define the swarm intelligence effect. We conduct a laboratory experiment (67 subjects) and observe the swarm intelligence effect only if $(p_{c},n_{I})$ are chosen so that social learning is far more optimal than asocial learning.

📄 PDF Abstract BibTeX arXiv:1503.03964

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Indexability of Finite State Restless Multi-Armed Bandit and Rollout Policy

2023-04-30 · Vishesh Mittal, Rahul Meshram, Deepak Dev, Surya Prakash

We consider finite state restless multi-armed bandit problem. The decision maker can act on M bandits out of N bandits in each time step. The play of arm (active arm) yields state dependent rewards based on action and wh…

Global Rewards in Restless Multi-Armed Bandits

2024-06-02 · Naveen Raman, Zheyuan Ryan Shi, Fei Fang

Restless multi-armed bandits (RMAB) extend multi-armed bandits so pulling an arm impacts future states. Despite the success of RMABs, a key limiting assumption is the separability of rewards into a sum across arms. We ad…

Multi-Armed Bandits

Lagrangian Relaxation for Multi-Action Partially Observable Restless Bandits: Heuristic Policies and Indexability

2025-08-30 · Rahul Meshram, Kesav Kaza arxiv

Partially observable restless multi-armed bandits have found numerous applications including in recommendation systems, communication systems, public healthcare outreach systems, and in operations research. We study mult…

Recommendation SystemsMulti-Armed Bandits

Networked Restless Bandits with Positive Externalities

2022-12-09 · Christine Herlihy, John P. Dickerson

Restless multi-armed bandits are often used to model budget-constrained resource allocation tasks where receipt of the resource is associated with an increased probability of a favorable state transition. Prior work assu…

Multi-Armed Bandits

Contextual Restless Multi-Armed Bandits with Application to Demand Response Decision-Making

2024-03-22 · Xin Chen, I-Hong Hou

This paper introduces a novel multi-armed bandits framework, termed Contextual Restless Bandits (CRB), for complex online decision-making. This CRB framework incorporates the core features of contextual bandits and restl…

Decision MakingMulti-Armed Bandits