Deep Learning-based Compression Detection for explainable Face Image Quality Assessment
The assessment of face image quality is crucial to ensure reliable face recognition. In order to provide data subjects and operators with explainable and actionable feedback regarding captured face images, relevant quality components have to be measured. Quality components that are known to negatively impact the utility of face images include JPEG and JPEG 2000 compression artefacts, among others. Compression can result in a loss of important image details which may impair the recognition performance. In this work, deep neural networks are trained to detect the compression artefacts in a face images. For this purpose, artefact-free facial images are compressed with the JPEG and JPEG 2000 compression algorithms. Subsequently, the PSNR and SSIM metrics are employed to obtain training labels based on which neural networks are trained using a single network to detect JPEG and JPEG 2000 artefacts, respectively. The evaluation of the proposed method shows promising results: in terms of detection accuracy, error rates of 2-3% are obtained for utilizing PSNR labels during training. In addition, we show that error rates of different open-source and commercial face recognition systems can be significantly reduced by discarding face images exhibiting severe compression artefacts. To minimize resource consumption, EfficientNetV2 serves as basis for the presented algorithm, which is available as part of the OFIQ software.
Code (2)
Tasks
Face Image QualityFace Image Quality AssessmentFace RecognitionImage Quality AssessmentSSIMMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Face Feature Visualisation of Single Morphing Attack Detection
This paper proposes an explainable visualisation of different face feature extraction algorithms that enable the detection of bona fide and morphing images for single morphing attack detection. The feature extraction is …
Effects of Image Compression on Face Image Manipulation Detection: A Case Study on Facial Retouching
In the past years, numerous methods have been introduced to reliably detect digital face image manipulations. Lately, the generalizability of these schemes has been questioned in particular with respect to image post-pro…
Image CompressionImage ManipulationImage Manipulation DetectionA New Benchmark and Model for Challenging Image Manipulation Detection
The ability to detect manipulation in multimedia data is vital in digital forensics. Existing Image Manipulation Detection (IMD) methods are mainly based on detecting anomalous features arisen from image editing or doubl…
Image ManipulationImage Manipulation DetectionHeartSpot: Privatized and Explainable Data Compression for Cardiomegaly Detection
Advances in data-driven deep learning for chest X-ray image analysis underscore the need for explainability, privacy, large datasets and significant computational resources. We frame privacy and explainability as a lossy…
Data CompressionImage CompressionEffect of Lossy Compression Algorithms on Face Image Quality and Recognition
Lossy face image compression can degrade the image quality and the utility for the purpose of face recognition. This work investigates the effect of lossy image compression on a state-of-the-art face recognition model, a…
Face Image QualityFace Image Quality AssessmentFace RecognitionImage Compression+1