paper-with-me

Papers

Faces of the Mind: Unveiling Mental Health States Through Facial Expressions in 11,427 Adolescents

2024-05-30 · Xiao Xu, Keyin Zhou, Yan Zhang, Yang Wang, Fei Wang, Xizhe Zhang

Mood disorders, including depression and anxiety, often manifest through facial expressions. While previous research has explored the connection between facial features and emotions, machine learning algorithms for estimating mood disorder severity have been hindered by small datasets and limited real-world application. To address this gap, we analyzed facial videos of 11,427 participants, a dataset two orders of magnitude larger than previous studies. This comprehensive collection includes standardized facial expression videos from reading tasks, along with a detailed psychological scale that measures depression, anxiety, and stress. By examining the relationships among these emotional states and employing clustering analysis, we identified distinct subgroups embodying different emotional profiles. We then trained tree-based classifiers and deep learning models to estimate emotional states from facial features. Results indicate that models previously effective on small datasets experienced decreased performance when applied to our large dataset, highlighting the importance of data scale and mitigating overfitting in practical settings. Notably, our study identified subtle shifts in pupil dynamics and gaze orientation as potential markers of mood disorders, providing valuable information on the interaction between facial expressions and mental health. This research marks the first large-scale and comprehensive investigation of facial expressions in the context of mental health, laying the groundwork for future data-driven advancements in this field.

📄 PDF Abstract BibTeX arXiv:2405.20072

Code (1)

xuxiaoooo/FACES 공식 구현 pytorch

Similar Papers 제목 키워드 기반

MindShift: Leveraging Large Language Models for Mental-States-Based Problematic Smartphone Use Intervention

2023-09-28 · Ruolan Wu, Chun Yu, Xiaole Pan, Yujia Liu 외

Problematic smartphone use negatively affects physical and mental health. Despite the wide range of prior research, existing persuasive techniques are not flexible enough to provide dynamic persuasion content based on us…

Persuasion Strategies

Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning

2026-02-01 · Meng Luo, Bobo Li, Shanqing Xu, Shize Zhang 외 arxiv

Despite rapid progress in multimodal large language models (MLLMs), their capability for deep emotional understanding remains limited. We argue that genuine affective intelligence requires explicit modeling of Theory of …

Reinforcement Learning

Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States

2026-09-14 · Zixuan Wang, Yufan Zhou, Jinzhou Tang, Xinle Yu 외 hf

As language models become more capable, long-term collaboration in learning, reasoning, and decision-making calls for a deeper understanding of the people they serve. Yet training such human-aware language models faces a…

Unveiling the Landscape of Clinical Depression Assessment: From Behavioral Signatures to Psychiatric Reasoning

2025-08-06 · Zhuang Chen, Guanqun Bi, Wen Zhang, Jiawei Hu 외 arxiv

Depression is a widespread mental disorder that affects millions worldwide. While automated depression assessment shows promise, most studies rely on limited or non-clinically validated data, and often prioritize complex…

MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agents

2025-11-28 · Ruoxuan Zhang, Qiyun Zheng, Zhiyu Zhou, Ziqi Liao 외 arxiv

Theory of Mind (ToM) refers to the ability to infer others' mental states, such as beliefs, desires, and intentions. Current vision-language embodied agents lack ToM-based decision-making, and existing benchmarks focus s…

Decision Making