Canonical Saliency Maps: Decoding Deep Face Models

2021-05-04 · Thrupthi Ann John, Vineeth N Balasubramanian, C V Jawahar

As Deep Neural Network models for face processing tasks approach human-like performance, their deployment in critical applications such as law enforcement and access control has seen an upswing, where any failure may have far-reaching consequences. We need methods to build trust in deployed systems by making their working as transparent as possible. Existing visualization algorithms are designed for object recognition and do not give insightful results when applied to the face domain. In this work, we present 'Canonical Saliency Maps', a new method that highlights relevant facial areas by projecting saliency maps onto a canonical face model. We present two kinds of Canonical Saliency Maps: image-level maps and model-level maps. Image-level maps highlight facial features responsible for the decision made by a deep face model on a given image, thus helping to understand how a DNN made a prediction on the image. Model-level maps provide an understanding of what the entire DNN model focuses on in each task and thus can be used to detect biases in the model. Our qualitative and quantitative results show the usefulness of the proposed canonical saliency maps, which can be used on any deep face model regardless of the architecture.

📄 PDF Abstract BibTeX arXiv:2105.01386

Code (1)

ThrupthiAnn/Canonical-Salient-Maps 공식 구현 pytorch

Tasks

Face ModelObject Recognition

Improving the Interpretability of fMRI Decoding using Deep Neural Networks and Adversarial Robustness

2020-04-23 · Patrick McClure, Dustin Moraczewski, Ka Chun Lam, Adam Thomas 외

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult t…

Adversarial Robustness

EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models

2025-10-30 · Igor Abramov, Ilya Makarov arxiv

Existing EEG-driven image reconstruction methods often overlook spatial attention mechanisms, limiting fidelity and semantic coherence. To address this, we propose a dual-conditioning framework that combines EEG embeddin…

Image Reconstruction Image Generation

Learning Saliency From Fixations

2023-11-23 · Yasser Abdelaziz Dahou Djilali, Kevin McGuiness, Noel O'Connor

We present a novel approach for saliency prediction in images, leveraging parallel decoding in transformers to learn saliency solely from fixation maps. Models typically rely on continuous saliency maps, to overcome the …

Decoder Prediction Saliency Prediction

Visual Saliency Maps Can Apply to Facial Expression Recognition

2018-11-12 · Zhenyue Qin, Jie Wu

Human eyes concentrate different facial regions during distinct cognitive activities. We study utilising facial visual saliency maps to classify different facial expressions into different emotions. Our results show that…

Facial Expression Recognition Facial Expression Recognition (FER)General Classification Saliency Prediction

High-Quality 3D Face Reconstruction with Affine Convolutional Networks

2023-10-22 · Zhiqian Lin, Jiangke Lin, Lincheng Li, Yi Yuan 외

Recent works based on convolutional encoder-decoder architecture and 3DMM parameterization have shown great potential for canonical view reconstruction from a single input image. Conventional CNN architectures benefit fr…

3D Face Reconstruction Decoder Face Reconstruction