PinView: Implicit Feedback in Content-Based Image Retrieval
This paper describes PinView, a content-based image retrieval system that exploits implicit relevance feedback collected during a search session. PinView contains several novel methods to infer the intent of the user. From relevance feedback, such as eye movements or pointer clicks, and visual features of images, PinView learns a similarity metric between images which depends on the current interests of the user. It then retrieves images with a specialized online learning algorithm that balances the tradeoff between exploring new images and exploiting the already inferred interests of the user. We have integrated PinView to the content-based image retrieval system PicSOM, which enables applying PinView to real-world image databases. With the new algorithms PinView outperforms the original PicSOM, and in online experiments with real users the combination of implicit and explicit feedback gives the best results.
Code (0)
등록된 구현이 없습니다.
Tasks
Content-Based Image RetrievalImage RetrievalRetrievalSimilar Papers 제목 키워드 기반
A Hybrid Approach for Improved Content-based Image Retrieval using Segmentation
The objective of Content-Based Image Retrieval (CBIR) methods is essentially to extract, from large (image) databases, a specified number of images similar in visual and semantic content to a so-called query image. To br…
Content-Based Image RetrievalImage RetrievalRetrievalImproving Relevance Prediction with Transfer Learning in Large-scale Retrieval Systems
Machine learned large-scale retrieval systems require a large amount of training data representing query-item relevance. However, collecting users' explicit feedback is costly. In this paper, we propose to leverage user …
RetrievalTransfer LearningAn Improved Relevance Feedback in CBIR
Relevance Feedback in Content-Based Image Retrieval is a method where the feedback of the performance is being used to improve itself. Prior works use feature re-weighting and classification techniques as the Relevance F…
Content-Based Image RetrievalImage RetrievalRetrievalCoSMo: Content-Style Modulation for Image Retrieval With Text Feedback
We tackle the task of image retrieval with text feedback, where a reference image and modifier text are combined to identify the desired target image. We focus on designing an image-text compositor, i.e., integrating…
Image RetrievalImage-text RetrievalRetrievalText RetrievalAutomatic Query Image Disambiguation for Content-Based Image Retrieval
Query images presented to content-based image retrieval systems often have various different interpretations, making it difficult to identify the search objective pursued by the user. We propose a technique for overcomin…
Content-Based Image RetrievalImage RetrievalRetrieval