홈 › Papers

Predicting Goal-directed Attention Control Using Inverse-Reinforcement Learning

2020-01-31 · Gregory J. Zelinsky, Yupei Chen, Seoyoung Ahn, Hossein Adeli, Zhibo Yang, Lihan Huang, Dimitrios Samaras, Minh Hoai

Understanding how goal states control behavior is a question ripe for interrogation by new methods from machine learning. These methods require large and labeled datasets to train models. To annotate a large-scale image dataset with observed search fixations, we collected 16,184 fixations from people searching for either microwaves or clocks in a dataset of 4,366 images (MS-COCO). We then used this behaviorally-annotated dataset and the machine learning method of Inverse-Reinforcement Learning (IRL) to learn target-specific reward functions and policies for these two target goals. Finally, we used these learned policies to predict the fixations of 60 new behavioral searchers (clock = 30, microwave = 30) in a disjoint test dataset of kitchen scenes depicting both a microwave and a clock (thus controlling for differences in low-level image contrast). We found that the IRL model predicted behavioral search efficiency and fixation-density maps using multiple metrics. Moreover, reward maps from the IRL model revealed target-specific patterns that suggest, not just attention guidance by target features, but also guidance by scene context (e.g., fixations along walls in the search of clocks). Using machine learning and the psychologically-meaningful principle of reward, it is possible to learn the visual features used in goal-directed attention control.

📄 PDF Abstract BibTeX arXiv:2001.11921

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Test 설명 없음

Predicting Goal-directed Human Attention Using Inverse Reinforcement Learning

2020-05-28 · CVPR 2020 6 · Zhibo Yang, Lihan Huang, Yupei Chen, Zijun Wei 외

Being able to predict human gaze behavior has obvious importance for behavioral vision and for computer vision applications. Most models have mainly focused on predicting free-viewing behavior using saliency maps, but th…

Object reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Inverse Reinforcement Learning: A Control Lyapunov Approach

2021-04-09 · Samuel Tesfazgi, Armin Lederer, Sandra Hirche

Inferring the intent of an intelligent agent from demonstrations and subsequently predicting its behavior, is a critical task in many collaborative settings. A common approach to solve this problem is the framework of in…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Intrinsic-Energy Joint Embedding Predictive Architectures Induce Quasimetric Spaces

2026-02-12 · Anthony Kobanda, Waris Radji arxiv

Joint-Embedding Predictive Architectures (JEPAs) aim to learn representations by predicting target embeddings from context embeddings, inducing a scalar compatibility energy in a latent space. In contrast, Quasimetric Re…

Reinforcement Learning

Estimating cognitive biases with attention-aware inverse planning

2025-10-29 · Sounak Banerjee, Daphne Cornelisse, Deepak Gopinath, Emily Sumner 외 arxiv

People's goal-directed behaviors are influenced by their cognitive biases, and autonomous systems that interact with people should be aware of this. For example, people's attention to objects in their environment will be…