Color Variants Identification in Fashion e-commerce via Contrastive Self-Supervised Representation Learning
In this paper, we utilize deep visual Representation Learning to address an important problem in fashion e-commerce: color variants identification, i.e., identifying fashion products that match exactly in their design (or style), but only to differ in their color. At first we attempt to tackle the problem by obtaining manual annotations (depicting whether two products are color variants), and train a supervised triplet loss based neural network model to learn representations of fashion products. However, for large scale real-world industrial datasets such as addressed in our paper, it is infeasible to obtain annotations for the entire dataset, while capturing all the difficult corner cases. Interestingly, we observed that color variants are essentially manifestations of color jitter based augmentations. Thus, we instead explore Self-Supervised Learning (SSL) to solve this problem. We observed that existing state-of-the-art SSL methods perform poor, for our problem. To address this, we propose a novel SSL based color variants model that simultaneously focuses on different parts of an apparel. Quantitative and qualitative evaluation shows that our method outperforms existing SSL methods, and at times, the supervised model.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationRepresentation LearningSelf-Supervised LearningTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Tale of Color Variants: Representation and Self-Supervised Learning in Fashion E-Commerce
In this paper, we address a crucial problem in fashion e-commerce (with respect to customer experience, as well as revenue): color variants identification, i.e., identifying fashion products that match exactly in their d…
Image AugmentationRepresentation LearningSelf-Supervised LearningEffective Conditioned and Composed Image Retrieval Combining CLIP-Based Features
Conditioned and composed image retrieval extend CBIR systems by combining a query image with an additional text that expresses the intent of the user, describing additional requests w.r.t. the visual content of the q…
Composed Image Retrieval (CoIR)Contrastive LearningImage RetrievalRetrievalEI-CLIP: Entity-Aware Interventional Contrastive Learning for E-Commerce Cross-Modal Retrieval
recommendation, and marketing services. Extensive efforts have been made to conquer the cross-modal retrieval problem in the general domain. When it comes to E-commerce, a common practice is to adopt the pretrained m…
Causal InferenceContrastive LearningCross-Modal RetrievalImage to text+2Interpretable Methods for Identifying Product Variants
For e-commerce companies with large product selections, the organization and grouping of products in meaningful ways is important for creating great customer shopping experiences and cultivating an authoritative brand im…
ClusteringConstrained ClusteringLearning-To-Embed: Adopting Transformer based models for E-commerce Products Representation Learning
Learning low-dimensional representation for large number of products present in an e-commerce catalogue plays a vital role as they are helpful in tasks like product ranking, product recommendation, finding similar produc…
Product RecommendationRepresentation LearningSentence