Saliency Weighted Convolutional Features for Instance Search
This work explores attention models to weight the contribution of local convolutional representations for the instance search task. We present a retrieval framework based on bags of local convolutional features (BLCF) that benefits from saliency weighting to build an efficient image representation. The use of human visual attention models (saliency) allows significant improvements in retrieval performance without the need to conduct region analysis or spatial verification, and without requiring any feature fine tuning. We investigate the impact of different saliency models, finding that higher performance on saliency benchmarks does not necessarily equate to improved performance when used in instance search tasks. The proposed approach outperforms the state-of-the-art on the challenging INSTRE benchmark by a large margin, and provides similar performance on the Oxford and Paris benchmarks compared to more complex methods that use off-the-shelf representations. The source code used in this project is available at https://imatge-upc.github.io/salbow/
Code (1)
Tasks
Instance SearchRetrievalSimilar Papers 제목 키워드 기반
Deep Networks for Saliency Detection via Local Estimation and Global Search
This paper presents a saliency detection algorithm by integrating both local estimation and global search. In the local estimation stage, we detect local saliency by using a deep neural network (DNN-L) which learns local…
ObjectSaliency DetectionInstance-Level Salient Object Segmentation
Image saliency detection has recently witnessed rapid progress due to deep convolutional neural networks. However, none of the existing methods is able to identify object instances in the detected salient regions. In thi…
Instance SegmentationObjectSaliency DetectionSegmentation+1Unsupervised Salient Instance Detection
The significant amount of manual efforts in annotating pixel-level labels has triggered the advancement of unsupervised saliency learning. However without supervision signals state-of-the-art methods can only infer r…
Explicit Document Modeling through Weighted Multiple-Instance Learning
Representing documents is a crucial component in many NLP tasks, for instance predicting aspect ratings in reviews. Previous methods for this task treat documents globally and do not acknowledge that target categories a…
Multiple Instance LearningSentenceSentiment AnalysisWeakly-supervised LearningSalient Object Detection with Lossless Feature Reflection and Weighted Structural Loss
Salient object detection (SOD), which aims to identify and locate the most salient pixels or regions in images, has been attracting more and more interest due to its various real-world applications. However, this vision …
Objectobject-detectionObject DetectionRGB Salient Object Detection+2