Triplet Synthesis For Enhancing Composed Image Retrieval via Counterfactual Image Generation
Composed Image Retrieval (CIR) provides an effective way to manage and access large-scale visual data. Construction of the CIR model utilizes triplets that consist of a reference image, modification text describing desired changes, and a target image that reflects these changes. For effectively training CIR models, extensive manual annotation to construct high-quality training datasets, which can be time-consuming and labor-intensive, is required. To deal with this problem, this paper proposes a novel triplet synthesis method by leveraging counterfactual image generation. By controlling visual feature modifications via counterfactual image generation, our approach automatically generates diverse training triplets without any manual intervention. This approach facilitates the creation of larger and more expressive datasets, leading to the improvement of CIR model's performance.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualImage GenerationImage RetrievalRetrievalTripletSimilar Papers 제목 키워드 기반
Automatic Synthesis of High-Quality Triplet Data for Composed Image Retrieval
As a challenging vision-language (VL) task, Composed Image Retrieval (CIR) aims to retrieve target images using multimodal (image+text) queries. Although many existing CIR methods have attained promising performance, the…
Image RetrievalLarge Language ModelRetrievalTripletHyCIR: Boosting Zero-Shot Composed Image Retrieval with Synthetic Labels
Composed Image Retrieval (CIR) aims to retrieve images based on a query image with text. Current Zero-Shot CIR (ZS-CIR) methods try to solve CIR tasks without using expensive triplet-labeled training datasets. However, t…
Contrastive LearningImage RetrievalImage to textLanguage Modelling+4Training-free Zero-shot Composed Image Retrieval with Local Concept Reranking
Composed image retrieval attempts to retrieve an image of interest from gallery images through a composed query of a reference image and its corresponding modified text. It has recently attracted attention due to the col…
Image RetrievalRerankingRe-RankingRetrieval+2Automatic Synthetic Data and Fine-grained Adaptive Feature Alignment for Composed Person Retrieval
Person retrieval has attracted rising attention. Existing methods are mainly divided into two retrieval modes, namely image-only and text-only. However, they are unable to make full use of the available information and a…
Image GenerationPerson RetrievalRetrievalText based Person Retrieval+2Learning with Noisy Triplet Correspondence for Composed Image Retrieval
Composed Image Retrieval (CIR) enables editable image search by integrating a query pair--a reference image ref and a textual modification mod--to retrieve a target image tar that reflects the intended change. While …
Image RetrievalRetrievalTARTriplet