paper-with-me

Papers

Identifying Emotions from Walking using Affective and Deep Features

2019-06-14 · Tanmay Randhavane, Uttaran Bhattacharya, Kyra Kapsaskis, Kurt Gray, Aniket Bera, Dinesh Manocha

We present a new data-driven model and algorithm to identify the perceived emotions of individuals based on their walking styles. Given an RGB video of an individual walking, we extract his/her walking gait in the form of a series of 3D poses. Our goal is to exploit the gait features to classify the emotional state of the human into one of four emotions: happy, sad, angry, or neutral. Our perceived emotion recognition approach uses deep features learned via LSTM on labeled emotion datasets. Furthermore, we combine these features with affective features computed from gaits using posture and movement cues. These features are classified using a Random Forest Classifier. We show that our mapping between the combined feature space and the perceived emotional state provides 80.07% accuracy in identifying the perceived emotions. In addition to classifying discrete categories of emotions, our algorithm also predicts the values of perceived valence and arousal from gaits. We also present an EWalk (Emotion Walk) dataset that consists of videos of walking individuals with gaits and labeled emotions. To the best of our knowledge, this is the first gait-based model to identify perceived emotions from videos of walking individuals.

📄 PDF Abstract BibTeX arXiv:1906.11884

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion Recognition

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Identifying Emotion from Natural Walking

2015-08-03 · Liqing Cui, Shun Li, Wan Zhang, Zhan Zhang 외

Emotion identification from gait aims to automatically determine persons affective state, it has attracted a great deal of interests and offered immense potential value in action tendency, health care, psychological dete…

ClassificationGeneral Classification

Take an Emotion Walk: Perceiving Emotions from Gaits Using Hierarchical Attention Pooling and Affective Mapping

2019-11-20 · ECCV 2020 8 · Uttaran Bhattacharya, Christian Roncal, Trisha Mittal, Rohan Chandra 외

We present an autoencoder-based semi-supervised approach to classify perceived human emotions from walking styles obtained from videos or motion-captured data and represented as sequences of 3D poses. Given the motion on…

Action RecognitionDecoderEmotion Recognition

STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits

2019-10-28 · Uttaran Bhattacharya, Trisha Mittal, Rohan Chandra, Tanmay Randhavane 외

We present a novel classifier network called STEP, to classify perceived human emotion from gaits, based on a Spatial Temporal Graph Convolutional Network (ST-GCN) architecture. Given an RGB video of an individual walkin…

General Classification

Enhancing Multimodal Affective Analysis with Learned Live Comment Features

2024-10-21 · Zhaoyuan Deng, Amith Ananthram, Kathleen McKeown

Live comments, also known as Danmaku, are user-generated messages that are synchronized with video content. These comments overlay directly onto streaming videos, capturing viewer emotions and reactions in real-time. Whi…

Contrastive LearningEmotion RecognitionSarcasm Detection

Zero-Shot Emotion Recognition via Affective Structural Embedding

2019-10-01 · ICCV 2019 10 · Chi Zhan, Dongyu She, Sicheng Zhao, Ming-Ming Cheng 외

Image emotion recognition attracts much attention in recent years due to its wide applications. It aims to classify the emotional response of humans, where candidate emotion categories are generally defined by specific p…

Emotion RecognitionZero-Shot Learning