paper-with-me

홈 › Papers

Towards A Comprehensive Visual Saliency Explanation Framework for AI-based Face Recognition Systems

2024-07-08 · Yuhang Lu, Zewei Xu, Touradj Ebrahimi

Over recent years, deep convolutional neural networks have significantly advanced the field of face recognition techniques for both verification and identification purposes. Despite the impressive accuracy, these neural networks are often criticized for lacking explainability. There is a growing demand for understanding the decision-making process of AI-based face recognition systems. Some studies have investigated the use of visual saliency maps as explanations, but they have predominantly focused on the specific face verification case. The discussion on more general face recognition scenarios and the corresponding evaluation methodology for these explanations have long been absent in current research. Therefore, this manuscript conceives a comprehensive explanation framework for face recognition tasks. Firstly, an exhaustive definition of visual saliency map-based explanations for AI-based face recognition systems is provided, taking into account the two most common recognition situations individually, i.e., face verification and identification. Secondly, a new model-agnostic explanation method named CorrRISE is proposed to produce saliency maps, which reveal both the similar and dissimilar regions between any given face images. Subsequently, the explanation framework conceives a new evaluation methodology that offers quantitative measurement and comparison of the performance of general visual saliency explanation methods in face recognition. Consequently, extensive experiments are carried out on multiple verification and identification scenarios. The results showcase that CorrRISE generates insightful saliency maps and demonstrates superior performance, particularly in similarity maps in comparison with the state-of-the-art explanation approaches.

📄 PDF Abstract BibTeX arXiv:2407.05983

Code (0)

등록된 구현이 없습니다.

Tasks

Face RecognitionFace Verification

Similar Papers 제목 키워드 기반

Towards Visual Saliency Explanations of Face Verification

2023-05-15 · Yuhang Lu, Zewei Xu, Touradj Ebrahimi

In the past years, deep convolutional neural networks have been pushing the frontier of face recognition (FR) techniques in both verification and identification scenarios. Despite the high accuracy, they are often critic…

Decision MakingFace RecognitionFace Verification

Explanation of Face Recognition via Saliency Maps

2023-04-12 · Yuhang Lu, Touradj Ebrahimi

Despite the significant progress in face recognition in the past years, they are often treated as "black boxes" and have been criticized for lacking explainability. It becomes increasingly important to understand the cha…

Decision MakingFace Recognition

Discriminative Deep Feature Visualization for Explainable Face Recognition

2023-06-01 · Zewei Xu, Yuhang Lu, Touradj Ebrahimi

Despite the huge success of deep convolutional neural networks in face recognition (FR) tasks, current methods lack explainability for their predictions because of their "black-box" nature. In recent years, studies have …

Face RecognitionFace Reconstruction

Rethinking Saliency Maps: A Cognitive Human Aligned Taxonomy and Evaluation Framework for Explanations

2025-11-17 · Yehonatan Elisha, Seffi Cohen, Oren Barkan, Noam Koenigstein arxiv

Saliency maps are widely used for visual explanations in deep learning, but a fundamental lack of consensus persists regarding their intended purpose and alignment with diverse user queries. This ambiguity hinders the ef…

SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches

2026-06-16 · Wencan Zhang, Mario Michelessa, Xuejun Zhao, Brian Y. Lim arxiv

Saliency map visualizations explain image-based AI predictions by pointing to regions, but these are often unintuitive and semantically unclear, leaving an interpretability gap. We argue that AI explanations should be in…