Bandit Models of Human Behavior: Reward Processing in Mental Disorders
Drawing an inspiration from behavioral studies of human decision making, we propose here a general parametric framework for multi-armed bandit problem, which extends the standard Thompson Sampling approach to incorporate reward processing biases associated with several neurological and psychiatric conditions, including Parkinson's and Alzheimer's diseases, attention-deficit/hyperactivity disorder (ADHD), addiction, and chronic pain. We demonstrate empirically that the proposed parametric approach can often outperform the baseline Thompson Sampling on a variety of datasets. Moreover, from the behavioral modeling perspective, our parametric framework can be viewed as a first step towards a unifying computational model capturing reward processing abnormalities across multiple mental conditions.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingThompson SamplingSimilar Papers 제목 키워드 기반
Unified Models of Human Behavioral Agents in Bandits, Contextual Bandits and RL
Artificial behavioral agents are often evaluated based on their consistent behaviors and performance to take sequential actions in an environment to maximize some notion of cumulative reward. However, human decision maki…
Decision MakingLifelong learningMulti-Armed BanditsReinforcement Learning (RL)+1Learning interactions to boost human creativity with bandits and GPT-4
This paper considers how interactions with AI algorithms can boost human creative thought. We employ a psychological task that demonstrates limits on human creativity, namely semantic feature generation: given a concept …
Modeling Human Decision-making in Generalized Gaussian Multi-armed Bandits
We present a formal model of human decision-making in explore-exploit tasks using the context of multi-armed bandit problems, where the decision-maker must choose among multiple options with uncertain rewards. We address…
Bayesian InferenceDecision MakingMulti-Armed BanditsReinforcement Learning Models of Human Behavior: Reward Processing in Mental Disorders
Drawing an inspiration from behavioral studies of human decision making, we propose here a general parametric framework for a reinforcement learning problem, which extends the standard Q-learning approach to incorporate …
Decision MakingQ-LearningRecommendation Systemsreinforcement-learning+1Semi-Parametric Contextual Bandits with Graph-Laplacian Regularization
Non-stationarity is ubiquitous in human behavior and addressing it in the contextual bandits is challenging. Several works have addressed the problem by investigating semi-parametric contextual bandits and warned that ig…
Multi-Armed BanditsThompson Sampling