Conversational Fashion Image Retrieval via Multiturn Natural Language Feedback
We study the task of conversational fashion image retrieval via multiturn natural language feedback. Most previous studies are based on single-turn settings. Existing models on multiturn conversational fashion image retrieval have limitations, such as employing traditional models, and leading to ineffective performance. We propose a novel framework that can effectively handle conversational fashion image retrieval with multiturn natural language feedback texts. One characteristic of the framework is that it searches for candidate images based on exploitation of the encoded reference image and feedback text information together with the conversation history. Furthermore, the image fashion attribute information is leveraged via a mutual attention strategy. Since there is no existing fashion dataset suitable for the multiturn setting of our task, we derive a large-scale multiturn fashion dataset via additional manual annotation efforts on an existing single-turn dataset. The experiments show that our proposed model significantly outperforms existing state-of-the-art methods.
Code (1)
Tasks
AttributeImage RetrievalRetrievalSimilar Papers 제목 키워드 기반
Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedback
Conversational interfaces for the detail-oriented retail fashion domain are more natural, expressive, and user friendly than classical keyword-based search interfaces. In this paper, we introduce the Fashion IQ dataset t…
AttributeImage RetrievalRetrievalCIRCLED: A Multi-turn CIR Dataset with Consistent Dialogues across Domains
Existing Multi-Turn Composed Image Retrieval (MTCIR) datasets lack dialogue-historyconsistency and are restricted to the fashion domain. To address these limitations, we construct CIRCLED by extending FashionIQ, CIRR, an…
Image RetrievalMultiTurnCleanup: A Benchmark for Multi-Turn Spoken Conversational Transcript Cleanup
Current disfluency detection models focus on individual utterances each from a single speaker. However, numerous discontinuity phenomena in spoken conversational transcripts occur across multiple turns, hampering human r…
Efficient Conversational Search via Topical Locality in Dense Retrieval
Pre-trained language models have been widely exploited to learn dense representations of documents and queries for information retrieval. While previous efforts have primarily focused on improving effectiveness and user …
Conversational SearchInformation RetrievalRetrievalDiverse-Intent Multi-Turn Fashion Image Retrieval
Real-world fashion search involves interactive retrieval across multiple turns. However, existing multi-turn retrieval methods are built on a restrictive assumption that every interaction follows the same attribute-editi…
Image Retrieval