paper-with-me

홈 › Papers

Human-Understandable Decision Making for Visual Recognition

2021-03-05 · Xiaowei Zhou, Jie Yin, Ivor Tsang, Chen Wang

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that humans cannot fully trust the predictions made by these models. To date, little work has been done on how to align the behaviors of deep learning models with human perception in order to train a human-understandable model. To fill this gap, we propose a new framework to train a deep neural network by incorporating the prior of human perception into the model learning process. Our proposed model mimics the process of perceiving conceptual parts from images and assessing their relative contributions towards the final recognition. The effectiveness of our proposed model is evaluated on two classical visual recognition tasks. The experimental results and analysis confirm our model is able to provide interpretable explanations for its predictions, but also maintain competitive recognition accuracy.

📄 PDF Abstract BibTeX arXiv:2103.03429

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Visualizing the Diversity of Representations Learned by Bayesian Neural Networks

2022-01-26 · Dennis Grinwald, Kirill Bykov, Shinichi Nakajima, Marina M. -C. Höhne

Explainable Artificial Intelligence (XAI) aims to make learning machines less opaque, and offers researchers and practitioners various tools to reveal the decision-making strategies of neural networks. In this work, we i…

Contrastive LearningDecision MakingDiversityExplainable artificial intelligence+1

Interpretability for Multimodal Emotion Recognition using Concept Activation Vectors

2022-02-02 · Ashish Ramayee Asokan, Nidarshan Kumar, Anirudh Venkata Ragam, Shylaja S Sharath

Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text). In recent years, Deep Neural networks have show…

Decision MakingEmotion RecognitionMultimodal Emotion Recognition

VITAL: More Understandable Feature Visualization through Distribution Alignment and Relevant Information Flow

2025-03-28 · Ada Gorgun, Bernt Schiele, Jonas Fischer

Neural networks are widely adopted to solve complex and challenging tasks. Especially in high-stakes decision-making, understanding their reasoning process is crucial, yet proves challenging for modern deep networks. Fea…

Decision Making

Human Saliency-Driven Patch-based Matching for Interpretable Post-mortem Iris Recognition

2022-08-03 · Aidan Boyd, Daniel Moreira, Andrey Kuehlkamp, Kevin Bowyer 외

Forensic iris recognition, as opposed to live iris recognition, is an emerging research area that leverages the discriminative power of iris biometrics to aid human examiners in their efforts to identify deceased persons…

Decision MakingIris Recognition

SEZ-HARN: Self-Explainable Zero-shot Human Activity Recognition Network

2025-06-25 · Devin Y. De Silva, Sandareka Wickramanayake, Dulani Meedeniya, Sanka Rasnayaka

Human Activity Recognition (HAR), which uses data from Inertial Measurement Unit (IMU) sensors, has many practical applications in healthcare and assisted living environments. However, its use in real-world scenarios has…

Activity RecognitionHuman Activity RecognitionZero-Shot Learning