paper-with-me

홈 › Papers

Learning via social awareness: Improving a deep generative sketching model with facial feedback

2018-02-13 · Natasha Jaques, Jennifer McCleary, Jesse Engel, David Ha, Fred Bertsch, Rosalind Picard, Douglas Eck

In the quest towards general artificial intelligence (AI), researchers have explored developing loss functions that act as intrinsic motivators in the absence of external rewards. This paper argues that such research has overlooked an important and useful intrinsic motivator: social interaction. We posit that making an AI agent aware of implicit social feedback from humans can allow for faster learning of more generalizable and useful representations, and could potentially impact AI safety. We collect social feedback in the form of facial expression reactions to samples from Sketch RNN, an LSTM-based variational autoencoder (VAE) designed to produce sketch drawings. We use a Latent Constraints GAN (LC-GAN) to learn from the facial feedback of a small group of viewers, by optimizing the model to produce sketches that it predicts will lead to more positive facial expressions. We show in multiple independent evaluations that the model trained with facial feedback produced sketches that are more highly rated, and induce significantly more positive facial expressions. Thus, we establish that implicit social feedback can improve the output of a deep learning model.

📄 PDF Abstract BibTeX arXiv:1802.04877

Code (0)

등록된 구현이 없습니다.

Tasks

AI Agent

Methods 이 논문이 사용한 방법론

Solana Customer Service Number +1-833-534-1729 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Avatar Visual Similarity for Social HCI: Increasing Self-Awareness

2024-08-23 · Bernhard Hilpert, Claudio Alves da Silva, Leon Christidis, Chirag Bhuvaneshwara 외

Self-awareness is a critical factor in social human-human interaction and, hence, in social HCI interaction. Increasing self-awareness through mirrors or video recordings is common in face-to-face trainings, since it inf…

DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modeling

2017-06-07 · Xiaoguang Han, Chang Gao, Yizhou Yu

Face modeling has been paid much attention in the field of visual computing. There exist many scenarios, including cartoon characters, avatars for social media, 3D face caricatures as well as face-related art and design,…

Caricature

Sketch2Stress: Sketching with Structural Stress Awareness

2023-06-09 · Deng Yu, Chufeng Xiao, Manfred Lau, Hongbo Fu

In the process of product design and digital fabrication, the structural analysis of a designed prototype is a fundamental and essential step. However, such a step is usually invisible or inaccessible to designers at the…

Facial Expression Generation Aligned with Human Preference for Natural Dyadic Interaction

2026-03-07 · Xu Chen, Rui Gao, Xinjie Zhang, Haoyu Zhang 외 arxiv

Achieving natural dyadic interaction requires generating facial expressions that are emotionally appropriate and socially aligned with human preference. Human feedback offers a compelling mechanism to guide such alignmen…

Reinforcement Learning

FaraPy: An Augmented Reality Feedback System for Facial Paralysis using Action Unit Intensity Estimation

2021-10-10 · Barrios Dell'Olio G, Sra M. FaraPy: An Augmented Reality Feedback System for Facial Paralysis using Action Unit Intensity Estimation. InThe 34th Annual ACM Symposium on User Interface Software and Technology 2021 10 · Giuliana Barrios Dell’Olio;Misha Sra

Facial paralysis is the most common facial nerve disorder. It causes functional and aesthetic defcitsthat often lead to emotional distress and afect psychosocial well-being. One form of treatment is mirror therapy, wh…