Multi-Task Curriculum Transfer Deep Learning of Clothing Attributes
Recognising detailed clothing characteristics (fine-grained attributes) in unconstrained images of people in-the-wild is a challenging task for computer vision, especially when there is only limited training data from the wild whilst most data available for model learning are captured in well-controlled environments using fashion models (well lit, no background clutter, frontal view, high-resolution). In this work, we develop a deep learning framework capable of model transfer learning from well-controlled shop clothing images collected from web retailers to in-the-wild images from the street. Specifically, we formulate a novel Multi-Task Curriculum Transfer (MTCT) deep learning method to explore multiple sources of different types of web annotations with multi-labelled fine-grained attributes. Our multi-task loss function is designed to extract more discriminative representations in training by jointly learning all attributes, and our curriculum strategy exploits the staged easy-to-complex transfer learning motivated by cognitive studies. We demonstrate the advantages of the MTCT model over the state-of-the-art methods on the X-Domain benchmark, a large scale clothing attribute dataset. Moreover, we show that the MTCT model has a notable advantage over contemporary models when the training data size is small.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeDeep LearningTransfer LearningSimilar Papers 제목 키워드 기반
Curriculum Learning for Multi-Task Classification of Visual Attributes
Visual attributes, from simple objects (e.g., backpacks, hats) to soft-biometrics (e.g., gender, height, clothing) have proven to be a powerful representational approach for many applications such as image description an…
AttributeClassificationGeneral ClassificationImage Description+1Curriculum Learning of Visual Attribute Clusters for Multi-Task Classification
Visual attributes, from simple objects (e.g., backpacks, hats) to soft-biometrics (e.g., gender, height, clothing) have proven to be a powerful representational approach for many applications such as image description an…
AttributeClassificationClusteringGeneral Classification+1Progressive Limb-Aware Virtual Try-On
Existing image-based virtual try-on methods directly transfer specific clothing to a human image without utilizing clothing attributes to refine the transferred clothing geometry and textures, which causes incomplete and…
AttributeHuman ParsingVirtual Try-onDETR-based Layered Clothing Segmentation and Fine-Grained Attribute Recognition
Clothing segmentation and fine-grained attribute recognition are challenging tasks at the crossing of computer vision and fashion, which segment the entire ensemble clothing instances as well as recognize detailed attrib…
AttributeSegmentationA Latent Clothing Attribute Approach for Human Pose Estimation
As a fundamental technique that concerns several vision tasks such as image parsing, action recognition and clothing retrieval, human pose estimation (HPE) has been extensively investigated in recent years. To achieve ac…
Action RecognitionAttributePose EstimationRetrieval+1