Multi-Dimensional, Nuanced and Subjective - Measuring the Perception of Facial Expressions
Humans can perceive multiple expressions, each one with varying intensity, in the picture of a face. We propose a methodology for collecting and modeling multidimensional modulated expression annotations from human annotators. Our data reveals that the perception of some expressions can be quite different across observers; thus, our model is designed to represent ambiguity alongside intensity. An empirical exploration of how many dimensions are necessary to capture the perception of facial expression suggests six principal expression dimensions are sufficient. Using our method, we collected multidimensional modulated expression annotations for 1,000 images culled from the popular ExpW in-the-wild dataset. As a proof of principle of our improved measurement technique, we used these annotations to benchmark four public domain algorithms for automated facial expression prediction.
Code (0)
등록된 구현이 없습니다.
Tasks
Facial Expression Recognition (FER)Similar Papers 제목 키워드 기반
POV Learning: Individual Alignment of Multimodal Models using Human Perception
Aligning machine learning systems with human expectations is mostly attempted by training with manually vetted human behavioral samples, typically explicit feedback. This is done on a population level since the context t…
It is not always greener on the other side: Greenery perception across demographics and personalities in multiple cities
Quantifying and assessing urban greenery is consequential for planning and development, reflecting the everlasting importance of green spaces for multiple climate and well-being dimensions of cities. Evaluation can be br…
Image quality assessment based on DCT subband similarity
Measuring image quality becomes increasingly important due to the many applications involving digital imaging and communication. Image quality assessment aims to develop a visual quality metric that correlates well with …
Full reference image quality assessmentFull-Reference Image Quality AssessmentImage Quality AssessmentMeasuring Successful Cooperation in Human-AI Teamwork: Development and Validation of the Perceived Cooperativity and Teaming Perception Scales
As human-AI cooperation becomes increasingly prevalent, reliable instruments for assessing the subjective quality of cooperative human-AI interaction are needed. We introduce two theoretically grounded scales: the Percei…
From Perception to Punchline: Empowering VLM with the Art of In-the-wild Meme
Generating humorous memes is a challenging multimodal task that moves beyond direct image-to-caption supervision. It requires a nuanced reasoning over visual content, contextual cues, and subjective humor. To bridge this…
Reinforcement Learningmultimodal generation