Semi-supervised Learning with a Teacher-student Network for Generalized Attribute Prediction
This paper presents a study on semi-supervised learning to solve the visual attribute prediction problem. In many applications of vision algorithms, the precise recognition of visual attributes of objects is important but still challenging. This is because defining a class hierarchy of attributes is ambiguous, so training data inevitably suffer from class imbalance and label sparsity, leading to a lack of effective annotations. An intuitive solution is to find a method to effectively learn image representations by utilizing unlabeled images. With that in mind, we propose a multi-teacher-single-student (MTSS) approach inspired by the multi-task learning and the distillation of semi-supervised learning. Our MTSS learns task-specific domain experts called teacher networks using the label embedding technique and learns a unified model called a student network by forcing a model to mimic the distributions learned by domain experts. Our experiments demonstrate that our method not only achieves competitive performance on various benchmarks for fashion attribute prediction, but also improves robustness and cross-domain adaptability for unseen domains.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeMulti-Task LearningSimilar Papers 제목 키워드 기반
Flipped Classroom: Aligning Teacher Attention with Student in Generalized Category Discovery
Recent advancements have shown promise in applying traditional Semi-Supervised Learning strategies to the task of Generalized Category Discovery (GCD). Typically, this involves a teacher-student framework in which the te…
JEDI: Joint Expert Distillation in a Semi-Supervised Multi-Dataset Student-Teacher Scenario for Video Action Recognition
We propose JEDI, a multi-dataset semi-supervised learning method, which efficiently combines knowledge from multiple experts, learned on different datasets, to train and improve the performance of individual, per dataset…
Action RecognitionTemporal Action LocalizationTeacher-Student MixIT for Unsupervised and Semi-supervised Speech Separation
In this paper, we introduce a novel semi-supervised learning framework for end-to-end speech separation. The proposed method first uses mixtures of unseparated sources and the mixture invariant training (MixIT) criterion…
Speech SeparationCompetitive Ensembling Teacher-Student Framework for Semi-Supervised Left Atrium MRI Segmentation
Semi-supervised learning has greatly advanced medical image segmentation since it effectively alleviates the need of acquiring abundant annotations from experts and utilizes unlabeled data which is much easier to acquire…
Image SegmentationLeft Atrium SegmentationMedical Image SegmentationMRI segmentation+3MagicNet: Semi-Supervised Multi-Organ Segmentation via Magic-Cube Partition and Recovery
We propose a novel teacher-student model for semi-supervised multi-organ segmentation. In teacher-student model, data augmentation is usually adopted on unlabeled data to regularize the consistent training between teache…
AnatomyData AugmentationImage SegmentationMedical Image Segmentation+3