paper-with-me

홈 › Papers

A Resource-Rational Principle for Modeling Visual Attention Control

2026-03-02 · Yunpeng Bai arxiv

Understanding how people allocate visual attention is central to Human-Computer Interaction (HCI), yet existing computational models of attention are often either descriptive, task-specific, or difficult to interpret. My dissertation develops a resource-rational, simulation-based framework for modeling visual attention as a sequential decision-making process under perceptual, memory, and time constraints. I formalize visual tasks, such as reading and multitasking, as bounded-optimal control problems using Partially Observable Markov Decision Processes, enabling eye-movement behaviors such as fixation and attention switching to emerge from rational adaptation rather than being hand-coded or purely data-driven. These models are instantiated in simulation environments spanning traditional text reading and reading-while-walking with smart glasses, where they reproduce classic empirical effects, explain observed trade-offs between comprehension and safety, and generate novel predictions under time pressure and interface variation. Collectively, this work contributes a unified computational account of visual attention, offering new tools for theory-driven and resource-efficient HCI design.

📄 PDF Abstract BibTeX arXiv:2603.02056

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Inverse Resource Rational Based Stochastic Driver Behavior Model

2022-07-14 · Mehmet Ozkan, Yao Ma

Human drivers have limited and time-varying cognitive resources when making decisions in real-world traffic scenarios, which often leads to unique and stochastic behaviors that can not be explained by perfect rationality…

modelModel Predictive Control

Digital Twin Online Channel Modeling: Challenges,Principles, and Applications

2025-01-15 · Junling Li, Cheng-Xiang Wang, Chen Huang, Tianrun Qi 외

Different from traditional offline channel modeling, digital twin online channel modeling can sense and accurately characterize dynamic wireless channels in real time, and can therefore greatly assist 6G network optimiza…

Deriving Machine Attention from Human Rationales

2018-08-28 · EMNLP 2018 10 · Yujia Bao, Shiyu Chang, Mo Yu, Regina Barzilay

Attention-based models are successful when trained on large amounts of data. In this paper, we demonstrate that even in the low-resource scenario, attention can be learned effectively. To this end, we start with discrete…

Heptapod: Language Modeling on Visual Signals

2025-10-08 · Yongxin Zhu, Jiawei Chen, Yuanzhe Chen, Zhuo Chen 외 arxiv

We introduce Heptapod, an image autoregressive model that adheres to the foundational principles of language modeling. Heptapod employs \textbf{causal attention}, \textbf{eliminates reliance on CFG}, and \textbf{eschews …

Self-Supervised Learning

Learning From Unique Perspectives: User-Aware Saliency Modeling

2023-01-01 · CVPR 2023 1 · Shi Chen, Nachiappan Valliappan, Shaolei Shen, Xinyu Ye 외

Everyone is unique. Given the same visual stimuli, people's attention is driven by both salient visual cues and their own inherent preferences. Knowledge of visual preferences not only facilitates understanding of fi…