Unsupervised Deep Representations for Learning Audience Facial Behaviors
In this paper, we present an unsupervised learning approach for analyzing facial behavior based on a deep generative model combined with a convolutional neural network (CNN). We jointly train a variational auto-encoder (VAE) and a generative adversarial network (GAN) to learn a powerful latent representation from footage of audiences viewing feature-length movies. We show that the learned latent representation successfully encodes meaningful signatures of behaviors related to audience engagement (smiling & laughing) and disengagement (yawning). Our results provide a proof of concept for a more general methodology for annotating hard-to-label multimedia data featuring sparse examples of signals of interest.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkSimilar Papers 제목 키워드 기반
Affect-Aware Deep Belief Network Representations for Multimodal Unsupervised Deception Detection
Automated systems that detect the social behavior of deception can enhance human well-being across medical, social work, and legal domains. Labeled datasets to train supervised deception detection models can rarely be co…
Deception DetectionInteractive Generative Adversarial Networks for Facial Expression Generation in Dyadic Interactions
A social interaction is a social exchange between two or more individuals,where individuals modify and adjust their behaviors in response to their interaction partners. Our social interactions are one of most fundamental…
Facial expression generationUnsupervised Disentanglement of Linear-Encoded Facial Semantics
We propose a method to disentangle linear-encoded facial semantics from StyleGAN without external supervision. The method derives from linear regression and sparse representation learning concepts to make the disentangle…
Data AugmentationDisentanglementRepresentation LearningMugeetion: Musical Interface Using Facial Gesture and Emotion
People feel emotions when listening to music. However, emotions are not tangible objects that can be exploited in the music composition process as they are difficult to capture and quantify in algorithms. We present a no…
Evaluation of Self-taught Learning-based Representations for Facial Emotion Recognition
This work describes different strategies to generate unsupervised representations obtained through the concept of self-taught learning for facial emotion recognition (FER). The idea is to create complementary representat…
DiversityEmotion RecognitionFacial Emotion Recognition