Salient Facial Features from Humans and Deep Neural Networks
In this work, we explore the features that are used by humans and by convolutional neural networks (ConvNets) to classify faces. We use Guided Backpropagation (GB) to visualize the facial features that influence the output of a ConvNet the most when identifying specific individuals; we explore how to best use GB for that purpose. We use a human intelligence task to find out which facial features humans find to be the most important for identifying specific individuals. We explore the differences between the saliency information gathered from humans and from ConvNets. Humans develop biases in employing available information on facial features to discriminate across faces. Studies show these biases are influenced both by neurological development and by each individual's social experience. In recent years the computer vision community has achieved human-level performance in many face processing tasks with deep neural network-based models. These face processing systems are also subject to systematic biases due to model architectural choices and training data distribution.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Automatic Facial Expression Recognition Using Features of Salient Facial Patches
Extraction of discriminative features from salient facial patches plays a vital role in effective facial expression recognition. The accurate detection of facial landmarks improves the localization of the salient patches…
Facial Expression RecognitionFacial Expression Recognition (FER)Facial Landmark DetectionGeneral ClassificationMaximized Posteriori Attributes Selection from Facial Salient Landmarks for Face Recognition
This paper presents a robust and dynamic face recognition technique based on the extraction and matching of devised probabilistic graphs drawn on SIFT features related to independent face areas. The face matching strateg…
Face RecognitionRecognition of facial expressions based on salient geometric features and support vector machines
Facial expressions convey nonverbal cues which play an important role in interpersonal relations, and are widely used in behavior interpretation of emotions, cognitive science, and social interactions. In this paper we a…
Facial Expression RecognitionFacial Expression Recognition (FER)Graph MatchingA cross-modal network for facial expression recognition
Deep neural networks enriched with structural information have been widely employed for facial expression recognition tasks. However, these methods often depend on hierarchical information rather than face property to fi…
Facial Expression RecognitionFace AlignmentSeeking Salient Facial Regions for Cross-Database Micro-Expression Recognition
Cross-Database Micro-Expression Recognition (CDMER) aims to develop the Micro-Expression Recognition (MER) methods with strong domain adaptability, i.e., the ability to recognize the Micro-Expressions (MEs) of different …
Domain AdaptationMicro Expression RecognitionMicro-Expression Recognitionvalid