Learning via social awareness: Improving a deep generative sketching model with facial feedback
In the quest towards general artificial intelligence (AI), researchers have explored developing loss functions that act as intrinsic motivators in the absence of external rewards. This paper argues that such research has overlooked an important and useful intrinsic motivator: social interaction. We posit that making an AI agent aware of implicit social feedback from humans can allow for faster learning of more generalizable and useful representations, and could potentially impact AI safety. We collect social feedback in the form of facial expression reactions to samples from Sketch RNN, an LSTM-based variational autoencoder (VAE) designed to produce sketch drawings. We use a Latent Constraints GAN (LC-GAN) to learn from the facial feedback of a small group of viewers, by optimizing the model to produce sketches that it predicts will lead to more positive facial expressions. We show in multiple independent evaluations that the model trained with facial feedback produced sketches that are more highly rated, and induce significantly more positive facial expressions. Thus, we establish that implicit social feedback can improve the output of a deep learning model.
Code (0)
등록된 구현이 없습니다.
Tasks
AI AgentMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Avatar Visual Similarity for Social HCI: Increasing Self-Awareness
Self-awareness is a critical factor in social human-human interaction and, hence, in social HCI interaction. Increasing self-awareness through mirrors or video recordings is common in face-to-face trainings, since it inf…
DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modeling
Face modeling has been paid much attention in the field of visual computing. There exist many scenarios, including cartoon characters, avatars for social media, 3D face caricatures as well as face-related art and design,…
CaricatureSketch2Stress: Sketching with Structural Stress Awareness
In the process of product design and digital fabrication, the structural analysis of a designed prototype is a fundamental and essential step. However, such a step is usually invisible or inaccessible to designers at the…
Facial Expression Generation Aligned with Human Preference for Natural Dyadic Interaction
Achieving natural dyadic interaction requires generating facial expressions that are emotionally appropriate and socially aligned with human preference. Human feedback offers a compelling mechanism to guide such alignmen…
Reinforcement LearningFaraPy: An Augmented Reality Feedback System for Facial Paralysis using Action Unit Intensity Estimation
Facial paralysis is the most common facial nerve disorder. It causes functional and aesthetic defcitsthat often lead to emotional distress and afect psychosocial well-being. One form of treatment is mirror therapy, wh…