Hallucinating Saliency Maps for Fine-Grained Image Classification for Limited Data Domains
Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which does not require explicit saliency maps to improve image classification, but they are learned implicitely, during the training of an end-to-end image classification task. We show that our approach obtains similar results as the case when the saliency maps are provided explicitely. Combining RGB data with saliency maps represents a significant advantage for object recognition, especially for the case when training data is limited. We validate our method on several datasets for fine-grained classification tasks (Flowers, Birds and Cars). In addition, we show that our saliency estimation method, which is trained without any saliency groundtruth data, obtains competitive results on real image saliency benchmark (Toronto), and outperforms deep saliency models with synthetic images (SID4VAM).
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationFine-Grained Image ClassificationGeneral Classificationimage-classificationImage ClassificationObject RecognitionSaliency PredictionSimilar Papers 제목 키워드 기반
Few-Shot Learning via Saliency-guided Hallucination of Samples
Learning new concepts from a few of samples is a standard challenge in computer vision. The main directions to improve the learning ability of few-shot training models include (i) a robust similarity learning and (ii) ge…
Few-Shot LearningHallucinationTSGB: Target-Selective Gradient Backprop for Probing CNN Visual Saliency
The explanation for deep neural networks has drawn extensive attention in the deep learning community over the past few years. In this work, we study the visual saliency, a.k.a. visual explanation, to interpret convoluti…
Saliency for Fine-grained Object Recognition in Domains with Scarce Training Data
This paper investigates the role of saliency to improve the classification accuracy of a Convolutional Neural Network (CNN) for the case when scarce training data is available. Our approach consists in adding a saliency …
Object RecognitionTop-Down Saliency Detection Driven by Visual Classification
This paper presents an approach for top-down saliency detection guided by visual classification tasks. We first learn how to compute visual saliency when a specific visual task has to be accomplished, as opposed to most …
ClassificationGeneral ClassificationSaliency DetectionSSiT: Saliency-guided Self-supervised Image Transformer for Diabetic Retinopathy Grading
Self-supervised Learning (SSL) has been widely applied to learn image representations through exploiting unlabeled images. However, it has not been fully explored in the medical image analysis field. In this work, Salien…
Contrastive LearningDiabetic Retinopathy GradingMedical Image AnalysisSelf-Supervised Learning