Pixel-Level Face Image Quality Assessment for Explainable Face Recognition
An essential factor to achieve high performance in face recognition systems is the quality of its samples. Since these systems are involved in daily life there is a strong need of making face recognition processes understandable for humans. In this work, we introduce the concept of pixel-level face image quality that determines the utility of pixels in a face image for recognition. We propose a training-free approach to assess the pixel-level qualities of a face image given an arbitrary face recognition network. To achieve this, a model-specific quality value of the input image is estimated and used to build a sample-specific quality regression model. Based on this model, quality-based gradients are back-propagated and converted into pixel-level quality estimates. In the experiments, we qualitatively and quantitatively investigated the meaningfulness of our proposed pixel-level qualities based on real and artificial disturbances and by comparing the explanation maps on faces incompliant with the ICAO standards. In all scenarios, the results demonstrate that the proposed solution produces meaningful pixel-level qualities enhancing the interpretability of the complete face image quality. The code is publicly available
Code (1)
Tasks
Face Image QualityFace Image Quality AssessmentFace RecognitionImage Quality AssessmentSimilar Papers 제목 키워드 기반
Pixel-by-pixel Mean Opinion Score (pMOS) for No-Reference Image Quality Assessment
Deep-learning based techniques have contributed to the remarkable progress in the field of automatic image quality assessment (IQA). Existing IQA methods are designed to measure the quality of an image in terms of Mean O…
Image Quality AssessmentNo-Reference Image Quality AssessmentRobust Sclera Segmentation for Skin-tone Agnostic Face Image Quality Assessment
Face image quality assessment (FIQA) is crucial for obtaining good face recognition performance. FIQA algorithms should be robust and insensitive to demographic factors. The eye sclera has a consistent whitish color in a…
Face Image QualityFace Image Quality AssessmentFace RecognitionImage Quality AssessmentQuality assessment of image matchers for DSM generation -- a comparative study based on UAV images
Recently developed automatic dense image matching algorithms are now being implemented for DSM/DTM production, with their pixel-level surface generation capability offering the prospect of partially alleviating the need …
3D Surface GenerationFunPiQ: A New Benchmark for Pixel-Level Quality Assessment in Fundus Images
Color fundus photography (CFP) is the most common ophthalmic imaging modality for large-scale screening. However, it is highly susceptible to degradations, making robust fundus image quality assessment (FIQA) crucial. Th…
Image Quality AssessmentAnomaly DetectionIQA-Spider: Unifying Multi-Granularity Image Quality Assessment with Reasoning, Grounding and Referring
We present IQA-Spider, the first image quality assessment (IQA) framework that unifies reasoning, grounding, and referring into a single LMM-based framework for multi-granularity quality understanding. Existing LMM-based…
Image Quality AssessmentQuestion Answering