I Only Have Eyes for You: The Impact of Masks On Convolutional-Based Facial Expression Recognition
The current COVID-19 pandemic has shown us that we are still facing unpredictable challenges in our society. The necessary constrain on social interactions affected heavily how we envision and prepare the future of social robots and artificial agents in general. Adapting current affective perception models towards constrained perception based on the hard separation between facial perception and affective understanding would help us to provide robust systems. In this paper, we perform an in-depth analysis of how recognizing affect from persons with masks differs from general facial expression perception. We evaluate how the recently proposed FaceChannel adapts towards recognizing facial expressions from persons with masks. In Our analysis, we evaluate different training and fine-tuning schemes to understand better the impact of masked facial expressions. We also perform specific feature-level visualization to demonstrate how the inherent capabilities of the FaceChannel to learn and combine facial features change when in a constrained social interaction scenario.
Code (0)
등록된 구현이 없습니다.
Tasks
Facial Expression RecognitionFacial Expression Recognition (FER)Similar Papers 제목 키워드 기반
Database of iris images acquired in the presence of ocular pathologies and assessment of iris recognition reliability for disease-affected eyes
This paper presents a database of iris images collected from disease affected eyes and an analysis related to the influence of ocular diseases on iris recognition reliability. For that purpose we have collected a databas…
Iris RecognitionIris Presentation Attack: Assessing the Impact of Combining Vanadium Dioxide Films with Artificial Eyes
Iris recognition systems, operating in the near infrared spectrum (NIR), have demonstrated vulnerability to presentation attacks, where an adversary uses artifacts such as cosmetic contact lenses, artificial eyes or prin…
Iris RecognitionShape Constrained Network for Eye Segmentation in the Wild
Semantic segmentation of eyes has long been a vital pre-processing step in many biometric applications. Majority of the works focus only on high resolution eye images, while little has been done to segment the eyes from …
SegmentationSemantic SegmentationIncorporating Network Built-in Priors in Weakly-supervised Semantic Segmentation
Pixel-level annotations are expensive and time consuming to obtain. Hence, weak supervision using only image tags could have a significant impact in semantic segmentation. Recently, CNN-based methods have proposed to fin…
Object RecognitionSegmentationSemantic SegmentationTAG+2Built-in Foreground/Background Prior for Weakly-Supervised Semantic Segmentation
Pixel-level annotations are expensive and time consuming to obtain. Hence, weak supervision using only image tags could have a significant impact in semantic segmentation. Recently, CNN-based methods have proposed to fin…
SegmentationSemantic SegmentationTAGWeakly supervised Semantic Segmentation+1