Multi-Semantic Image Recognition Model and Evaluating Index for explaining the deep learning models
Although deep learning models are powerful among various applications, most deep learning models are still a black box, lacking verifiability and interpretability, which means the decision-making process that human beings cannot understand. Therefore, how to evaluate deep neural networks with explanations is still an urgent task. In this paper, we first propose a multi-semantic image recognition model, which enables human beings to understand the decision-making process of the neural network. Then, we presents a new evaluation index, which can quantitatively assess the model interpretability. We also comprehensively summarize the semantic information that affects the image classification results in the judgment process of neural networks. Finally, this paper also exhibits the relevant baseline performance with current state-of-the-art deep learning models.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingDeep Learningimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
NeighCNN: A CNN based SAR Speckle Reduction using Feature preserving Loss Function
Coherent imaging systems like synthetic aperture radar are susceptible to multiplicative noise that makes applications like automatic target recognition challenging. In this paper, NeighCNN, a deep learning-based speckle…
Semantic Indexing of Multilingual Corpora and its Application on the History Domain
The increasing amount of multilingual text collections available in different domains makes its automatic processing essential for the development of a given field. However, standard processing techniques based on statis…
RetrievalText RetrievalTranslationBeyond Word Error Rate: Auditing the Diversity Tax in Speech Recognition through Dataset Cartography
Automatic speech recognition (ASR) systems are predominantly evaluated using the Word Error Rate (WER). However, raw token-level metrics fail to capture semantic fidelity and routinely obscures the `diversity tax', the d…
Speech RecognitionMulti-Vector Index Compression in Any Modality
We study efficient multi-vector retrieval for late interaction in any modality. Late interaction has emerged as a dominant paradigm for information retrieval in text, images, visual documents, and videos, but its computa…
Information RetrievalSVM and ELM: Who Wins? Object Recognition with Deep Convolutional Features from ImageNet
Deep learning with a convolutional neural network (CNN) has been proved to be very effective in feature extraction and representation of images. For image classification problems, this work aim at finding which classifie…
General Classificationimage-classificationImage ClassificationObject Recognition