paper-with-me

Papers

Modeling Boundedly Rational Agents with Latent Inference Budgets

2023-12-07 · Athul Paul Jacob, Abhishek Gupta, Jacob Andreas

We study the problem of modeling a population of agents pursuing unknown goals subject to unknown computational constraints. In standard models of bounded rationality, sub-optimal decision-making is simulated by adding homoscedastic noise to optimal decisions rather than explicitly simulating constrained inference. In this work, we introduce a latent inference budget model (L-IBM) that models agents' computational constraints explicitly, via a latent variable (inferred jointly with a model of agents' goals) that controls the runtime of an iterative inference algorithm. L-IBMs make it possible to learn agent models using data from diverse populations of suboptimal actors. In three modeling tasks -- inferring navigation goals from routes, inferring communicative intents from human utterances, and predicting next moves in human chess games -- we show that L-IBMs match or outperform Boltzmann models of decision-making under uncertainty. Inferred inference budgets are themselves meaningful, efficient to compute, and correlated with measures of player skill, partner skill and task difficulty.

📄 PDF Abstract BibTeX arXiv:2312.04030

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDecision Making Under Uncertainty

Similar Papers 제목 키워드 기반

Modeling the Mistakes of Boundedly Rational Agents Within a Bayesian Theory of Mind

2021-06-24 · Arwa Alanqary, Gloria Z. Lin, Joie Le, Tan Zhi-Xuan 외

When inferring the goals that others are trying to achieve, people intuitively understand that others might make mistakes along the way. This is crucial for activities such as teaching, offering assistance, and deciding …

Game of Chess

Online Bayesian Goal Inference for Boundedly-Rational Planning Agents

2020-06-13 · Tan Zhi-Xuan, Jordyn L. Mann, Tom Silver, Joshua B. Tenenbaum 외

People routinely infer the goals of others by observing their actions over time. Remarkably, we can do so even when those actions lead to failure, enabling us to assist others when we detect that they might not achieve t…

Bayesian Inference

Online Bayesian Goal Inference for Boundedly Rational Planning Agents

2020-12-01 · NeurIPS 2020 12 · Tan Zhi-Xuan, Jordyn Mann, Tom Silver, Josh Tenenbaum 외

People routinely infer the goals of others by observing their actions over time. Remarkably, we can do so even when those actions lead to failure, enabling us to assist others when we detect that they might not achieve t…

Bayesian Inference

Learning to Play General-Sum Games Against Multiple Boundedly Rational Agents

2021-06-10 · Eric Zhao, Alexander R. Trott, Caiming Xiong, Stephan Zheng

We study the problem of training a principal in a multi-agent general-sum game using reinforcement learning (RL). Learning a robust principal policy requires anticipating the worst possible strategic responses of other a…

Decision MakingMulti-agent Reinforcement LearningReinforcement Learning (RL)

Interactive POMDP Lite: Towards Practical Planning to Predict and Exploit Intentions for Interacting with Self-Interested Agents

2013-04-18 · Trong Nghia Hoang, Kian Hsiang Low

A key challenge in non-cooperative multi-agent systems is that of developing efficient planning algorithms for intelligent agents to interact and perform effectively among boundedly rational, self-interested agents (e.g.…