Fun Selfie Filters in Face Recognition: Impact Assessment and Removal
This work investigates the impact of fun selfie filters, which are frequently used to modify selfies, on face recognition systems. Based on a qualitative assessment and classification of freely available mobile applications, ten relevant fun selfie filters are selected to create a database. To this end, the selected filters are automatically applied to face images of public face image databases. Different state-of-the-art methods are used to evaluate the influence of fun selfie filters on the performance of face detection using dlib, RetinaFace, and a COTS method, sample quality estimated by FaceQNet and MagFace, and recognition accuracy employing ArcFace and a COTS algorithm. The obtained results indicate that selfie filters negatively affect face recognition modules, especially if fun selfie filters cover a large region of the face, where the mouth, nose, and eyes are covered. To mitigate such unwanted effects, a GAN-based selfie filter removal algorithm is proposed which consists of a segmentation module, a perceptual network, and a generation module. In a cross-database experiment the application of the presented selfie filter removal technique has shown to significantly improve the biometric performance of the underlying face recognition systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Face DetectionFace RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FaceFilterSense: A Filter-Resistant Face Recognition and Facial Attribute Analysis Framework
With the advent of social media, fun selfie filters have come into tremendous mainstream use affecting the functioning of facial biometric systems as well as image recognition systems. These filters vary from beautificat…
Age EstimationAttributeFace RecognitionOn the Effect of Selfie Beautification Filters on Face Detection and Recognition
Beautification and augmented reality filters are very popular in applications that use selfie images captured with smartphones or personal devices. However, they can distort or modify biometric features, severely affecti…
Face DetectionLFW-Beautified: A Dataset of Face Images with Beautification and Augmented Reality Filters
Selfie images enjoy huge popularity in social media. The same platforms centered around sharing this type of images offer filters to beautify them or incorporate augmented reality effects. Studies suggests that filtered …
Face DetectionImage EnhancementPerson RecognitionWSD: Wild Selfie Dataset for Face Recognition in Selfie Images
With the rise of handy smart phones in the recent years, the trend of capturing selfie images is observed. Hence efficient approaches are required to be developed for recognising faces in selfie images. Due to the short …
Face RecognitionSelfie Periocular Verification using an Efficient Super-Resolution Approach
Selfie-based biometrics has great potential for a wide range of applications since, e.g. periocular verification is contactless and is safe to use in pandemics such as COVID-19, when a major portion of a face is covered …
Image Super-ResolutionSuper-Resolution