Semi-Supervised Visual Representation Learning for Fashion Compatibility
We consider the problem of complementary fashion prediction. Existing approaches focus on learning an embedding space where fashion items from different categories that are visually compatible are closer to each other. However, creating such labeled outfits is intensive and also not feasible to generate all possible outfit combinations, especially with large fashion catalogs. In this work, we propose a semi-supervised learning approach where we leverage large unlabeled fashion corpus to create pseudo-positive and pseudo-negative outfits on the fly during training. For each labeled outfit in a training batch, we obtain a pseudo-outfit by matching each item in the labeled outfit with unlabeled items. Additionally, we introduce consistency regularization to ensure that representation of the original images and their transformations are consistent to implicitly incorporate colour and other important attributes through self-supervision. We conduct extensive experiments on Polyvore, Polyvore-D and our newly created large-scale Fashion Outfits datasets, and show that our approach with only a fraction of labeled examples performs on-par with completely supervised methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Fashion UnderstandingProduct RecommendationRecommendation SystemsRepresentation LearningSemi-Supervised Fashion CompatibilityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semi-supervised Fashion Compatibility Prediction by Color Distortion Prediction
Supervised learning methods have been suffering from the fact that a large-scale labeled dataset is mandatory, which is difficult to obtain. This has been a more significant issue for fashion compatibility prediction bec…
PredictionSemi-Supervised Fashion CompatibilitySemi-supervised Compatibility Learning Across Categories for Clothing Matching
Learning the compatibility between fashion items across categories is a key task in fashion analysis, which can decode the secret of clothing matching. The main idea of this task is to map items into a latent style space…
FiNet: Compatible and Diverse Fashion Image Inpainting
Visual compatibility is critical for fashion analysis, yet is missing in existing fashion image synthesis systems. In this paper, we propose to explicitly model visual compatibility through fashion image inpainting. We p…
Fashion SynthesisImage GenerationImage InpaintingSelf-supervised Visual Attribute Learning for Fashion Compatibility
Many self-supervised learning (SSL) methods have been successful in learning semantically meaningful visual representations by solving pretext tasks. However, prior work in SSL focuses on tasks like object recognition or…
AttributeObject RecognitionRetrievalSelf-Supervised Learning+1Compatible and Diverse Fashion Image Inpainting
Visual compatibility is critical for fashion analysis, yet is missing in existing fashion image synthesis systems. In this paper, we propose to explicitly model visual compatibility through fashion image inpainting. To t…
Fashion SynthesisImage GenerationImage Inpainting