Composed Query Image Retrieval Using Locally Bounded Features
Composed query image retrieval is a new problem where the query consists of an image together with a requested modification expressed via a textual sentence. The goal is then to retrieve the images that are generally similar to the query image, but differ according to the requested modification. Previous methods usually consider the image as a whole. In this paper, we propose a novel method that represents the image using a set of local areas in the image. The relationship between each word in the modification text and each area in the image is then explicitly established, allowing the model to accurately correlate the modification text to parts of the image. We conduct extensive experiments on three benchmark datasets. The results show that our method outperforms other state-of-the-art approaches by a considerable margin.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RetrievalRetrievalSentenceSimilar Papers 제목 키워드 기반
CaLa: Complementary Association Learning for Augmenting Composed Image Retrieval
Composed Image Retrieval (CIR) involves searching for target images based on an image-text pair query. While current methods treat this as a query-target matching problem, we argue that CIR triplets contain additional as…
Cross-Modal RetrievalImage RetrievalRelationRetrieval+1Zero-shot Composed Image Retrieval Considering Query-target Relationship Leveraging Masked Image-text Pairs
This paper proposes a novel zero-shot composed image retrieval (CIR) method considering the query-target relationship by masked image-text pairs. The objective of CIR is to retrieve the target image using a query image a…
Image RetrievalLanguage ModelingLanguage ModellingRetrievalTraining-free Zero-shot Composed Image Retrieval with Local Concept Reranking
Composed image retrieval attempts to retrieve an image of interest from gallery images through a composed query of a reference image and its corresponding modified text. It has recently attracted attention due to the col…
Image RetrievalRerankingRe-RankingRetrieval+2Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxy
The Zero-shot Composed Image Retrieval (ZSCIR) requires retrieving images that match the query image and the relative captions. Current methods focus on projecting the query image into the text feature space, subsequentl…
Image RetrievalRetrievalZero-Shot Composed Image Retrieval (ZS-CIR)Zero-Shot Composed Image Retrieval with Textual Inversion
Composed Image Retrieval (CIR) aims to retrieve a target image based on a query composed of a reference image and a relative caption that describes the difference between the two images. The high effort and cost required…
Composed Image Retrieval (CoIR)Image RetrievalRetrievalZero-Shot Composed Image Retrieval (ZS-CIR)