Structure Learning in Human Sequential Decision-Making
We use graphical models and structure learning to explore how people learn policies in sequential decision making tasks. Studies of sequential decision-making in humans frequently find suboptimal performance relative to an ideal actor that knows the graph model that generates reward in the environment. We argue that the learning problem humans face also involves learning the graph structure for reward generation in the environment. We formulate the structure learning problem using mixtures of reward models, and solve the optimal action selection problem using Bayesian Reinforcement Learning. We show that structure learning in one and two armed bandit problems produces many of the qualitative behaviors deemed suboptimal in previous studies. Our argument is supported by the results of experiments that demonstrate humans rapidly learn and exploit new reward structure.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)Sequential Decision MakingSimilar Papers 제목 키워드 기반
On the Relationship Between Structure in Natural Language and Models of Sequential Decision Processes
Human language is distinguished by powerful semantics, rich structure, and incredible flexibility. It enables us to communicate with each other, thereby affecting the decisions we make and actions we take. While Artifici…
Decision MakingSequential Decision MakingImproving Human Decision-Making by Discovering Efficient Strategies for Hierarchical Planning
To make good decisions in the real world people need efficient planning strategies because their computational resources are limited. Knowing which planning strategies would work best for people in different situations w…
Computational EfficiencyDecision Makingreinforcement-learningReinforcement Learning (RL)+1On the Role of Information Structure in Reinforcement Learning for Partially-Observable Sequential Teams and Games
In a sequential decision-making problem, the information structure is the description of how events in the system occurring at different points in time affect each other. Classical models of reinforcement learning (e.g.,…
Decision Makingreinforcement-learningReinforcement LearningSequential Decision MakingSynthetically Generating Human-like Data for Sequential Decision Making Tasks via Reward-Shaped Imitation Learning
We consider the problem of synthetically generating data that can closely resemble human decisions made in the context of an interactive human-AI system like a computer game. We propose a novel algorithm that can generat…
Decision MakingImitation LearningSequential Decision MakingSynthetic Data GenerationCan Induced Emotion Bias LLM Behaviors in Sequential Decision Making?
As Large Language Models (LLMs) are increasingly deployed as autonomous agents in high-stakes domains, understanding contextual factors that may modulate their decision-making becomes critical. While LLMs are trained to …
Decision Making