paper-with-me

Papers

Improving Human Decision-Making by Discovering Efficient Strategies for Hierarchical Planning

2021-01-31 · Saksham Consul, Lovis Heindrich, Jugoslav Stojcheski, Falk Lieder

To make good decisions in the real world people need efficient planning strategies because their computational resources are limited. Knowing which planning strategies would work best for people in different situations would be very useful for understanding and improving human decision-making. But our ability to compute those strategies used to be limited to very small and very simple planning tasks. To overcome this computational bottleneck, we introduce a cognitively-inspired reinforcement learning method that can overcome this limitation by exploiting the hierarchical structure of human behavior. The basic idea is to decompose sequential decision problems into two sub-problems: setting a goal and planning how to achieve it. This hierarchical decomposition enables us to discover optimal strategies for human planning in larger and more complex tasks than was previously possible. The discovered strategies outperform existing planning algorithms and achieve a super-human level of computational efficiency. We demonstrate that teaching people to use those strategies significantly improves their performance in sequential decision-making tasks that require planning up to eight steps ahead. By contrast, none of the previous approaches was able to improve human performance on these problems. These findings suggest that our cognitively-informed approach makes it possible to leverage reinforcement learning to improve human decision-making in complex sequential decision-problems. Future work can leverage our method to develop decision support systems that improve human decision making in the real world.

📄 PDF Abstract BibTeX arXiv:2102.00521

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyDecision Makingreinforcement-learningReinforcement Learning (RL)Sequential Decision Making

Similar Papers 제목 키워드 기반

Boosting human decision-making with AI-generated decision aids

2022-03-05 · Frederic Becker, Julian Skirzyński, Bas van Opheusden, Falk Lieder

Human decision-making is plagued by many systematic errors. Many of these errors can be avoided by providing decision aids that guide decision-makers to attend to the important information and integrate it according to a…

Decision Making

Automatic Discovery of Interpretable Planning Strategies

2020-05-24 · Julian Skirzyński, Frederic Becker, Falk Lieder

When making decisions, people often overlook critical information or are overly swayed by irrelevant information. A common approach to mitigate these biases is to provide decision-makers, especially professionals such as…

ClusteringDecision MakingImitation LearningProgram induction+2

An intelligent tutor for planning in large partially observable environments

2023-02-06 · Lovis Heindrich, Saksham Consul, Falk Lieder

AI can not only outperform people in many planning tasks, but it can also teach them how to plan better. A recent and promising approach to improving human decision-making is to create intelligent tutors that utilize AI …

ReAL-AD: Towards Human-Like Reasoning in End-to-End Autonomous Driving

2025-07-16 · Yuhang Lu, Jiadong Tu, Yuexin Ma, Xinge Zhu arxiv

End-to-end autonomous driving has emerged as a promising approach to unify perception, prediction, and planning within a single framework, reducing information loss and improving adaptability. However, existing methods o…

Autonomous Driving

Human-machine Hierarchical Networks for Decision Making under Byzantine Attacks

2023-01-25 · Chen Quan, Baocheng Geng, Yunghsiang S. Han, Pramod K. Varshney

This paper proposes a belief-updating scheme in a human-machine collaborative decision-making network to combat Byzantine attacks. A hierarchical framework is used to realize the network where local decisions from physic…

Decision Making