paper-with-me

Papers

Camera-based implicit mind reading by capturing higher-order semantic dynamics of human gaze within environmental context

2025-07-17 · Mengke Song, Yuge Xie, Qi Cui, Luming Li, Xinyu Liu, Guotao Wang, Chenglizhao Chen, Shanchen Pang

Emotion recognition,as a step toward mind reading,seeks to infer internal states from external cues.Most existing methods rely on explicit signals-such as facial expressions,speech,or gestures-that reflect only bodily responses and overlook the influence of environmental context.These cues are often voluntary,easy to mask,and insufficient for capturing deeper,implicit emotions. Physiological signal-based approaches offer more direct access to internal states but require complex sensors that compromise natural behavior and limit scalability.Gaze-based methods typically rely on static fixation analysis and fail to capture the rich,dynamic interactions between gaze and the environment,and thus cannot uncover the deep connection between emotion and implicit behavior.To address these limitations,we propose a novel camera-based,user-unaware emotion recognition approach that integrates gaze fixation patterns with environmental semantics and temporal dynamics.Leveraging standard HD cameras,our method unobtrusively captures users'eye appearance and head movements in natural settings-without the need for specialized hardware or active user participation.From these visual cues,the system estimates gaze trajectories over time and space, providing the basis for modeling the spatial, semantic,and temporal dimensions of gaze behavior. This allows us to capture the dynamic interplay between visual attention and the surrounding environment,revealing that emotions are not merely physiological responses but complex outcomes of human-environment interactions.The proposed approach enables user-unaware,real-time,and continuous emotion recognition,offering high generalizability and low deployment cost.

📄 PDF Abstract BibTeX arXiv:2507.12889

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion Recognition

Similar Papers 제목 키워드 기반

What deep learning can tell us about higher cognitive functions like mindreading?

2018-03-28 · Jaan Aru, Raul Vicente

Can deep learning (DL) guide our understanding of computations happening in biological brain? We will first briefly consider how DL has contributed to the research on visual object recognition. In the main part we will a…

Object Recognition

Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker

2023-06-01 · Melanie Sclar, Sachin Kumar, Peter West, Alane Suhr 외

Theory of Mind (ToM)$\unicode{x2014}$the ability to reason about the mental states of other people$\unicode{x2014}$is a key element of our social intelligence. Yet, despite their ever more impressive performance, large-s…

Reading Comprehension

Robot Mindreading and the Problem of Trust

2020-03-02 · Andrés Páez

This paper raises three questions regarding the attribution of beliefs, desires, and intentions to robots. The first one is whether humans in fact engage in robot mindreading. If they do, this raises a second question: d…

"What is on your mind?" Automated Scoring of Mindreading in Childhood and Early Adolescence

2020-11-16 · Venelin Kovatchev, Phillip Smith, Mark Lee, Imogen Grumley Traynor 외

In this paper we present the first work on the automated scoring of mindreading ability in middle childhood and early adolescence. We create MIND-CA, a new corpus of 11,311 question-answer pairs in English from 1,066 chi…

BIG-bench Machine Learning

``What is on your mind?'' Automated Scoring of Mindreading in Childhood and Early Adolescence

2020-12-01 · COLING 2020 8 · Venelin Kovatchev, Phillip Smith, Mark Lee, Imogen Grumley Traynor 외

In this paper we present the first work on the automated scoring of mindreading ability in middle childhood and early adolescence. We create MIND-CA, a new corpus of 11,311 question-answer pairs in English from 1,066 chi…