Head Matters: Explainable Human-centered Trait Prediction from Head Motion Dynamics
We demonstrate the utility of elementary head-motion units termed kinemes for behavioral analytics to predict personality and interview traits. Transforming head-motion patterns into a sequence of kinemes facilitates discovery of latent temporal signatures characterizing the targeted traits, thereby enabling both efficient and explainable trait prediction. Utilizing Kinemes and Facial Action Coding System (FACS) features to predict (a) OCEAN personality traits on the First Impressions Candidate Screening videos, and (b) Interview traits on the MIT dataset, we note that: (1) A Long-Short Term Memory (LSTM) network trained with kineme sequences performs better than or similar to a Convolutional Neural Network (CNN) trained with facial images; (2) Accurate predictions and explanations are achieved on combining FACS action units (AUs) with kinemes, and (3) Prediction performance is affected by the time-length over which head and facial movements are observed.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Explainable Human-centered Traits from Head Motion and Facial Expression Dynamics
We explore the efficacy of multimodal behavioral cues for explainable prediction of personality and interview-specific traits. We utilize elementary head-motion units named kinemes, atomic facial movements termed action …
PredictionComparing Pre-trained Human Language Models: Is it Better with Human Context as Groups, Individual Traits, or Both?
Pre-trained language models consider the context of neighboring words and documents but lack any author context of the human generating the text. However, language depends on the author's states, traits, social, situatio…
Age EstimationLanguage ModelingLanguage ModellingA Human-Centered Approach for Improving Supervised Learning
Supervised Learning is a way of developing Artificial Intelligence systems in which a computer algorithm is trained on labeled data inputs. Effectiveness of a Supervised Learning algorithm is determined by its performanc…
Ensemble LearningTowards Human-centered Explainable AI: A Survey of User Studies for Model Explanations
Explainable AI (XAI) is widely viewed as a sine qua non for ever-expanding AI research. A better understanding of the needs of XAI users, as well as human-centered evaluations of explainable models are both a necessity a…
Explainable Artificial Intelligence (XAI)Explainable ModelsFairnessRecommendation Systems+1A Survey on Human-Centered Evaluation of Explainable AI Methods in Clinical Decision Support Systems
Explainable AI (XAI) has become a crucial component of Clinical Decision Support Systems (CDSS) to enhance transparency, trust, and clinical adoption. However, while many XAI methods have been proposed, their effectivene…