paper-with-me

홈 › Papers

Semi-supervised Learning with a Teacher-student Network for Generalized Attribute Prediction

2020-07-14 · ECCV 2020 8 · Minchul Shin

This paper presents a study on semi-supervised learning to solve the visual attribute prediction problem. In many applications of vision algorithms, the precise recognition of visual attributes of objects is important but still challenging. This is because defining a class hierarchy of attributes is ambiguous, so training data inevitably suffer from class imbalance and label sparsity, leading to a lack of effective annotations. An intuitive solution is to find a method to effectively learn image representations by utilizing unlabeled images. With that in mind, we propose a multi-teacher-single-student (MTSS) approach inspired by the multi-task learning and the distillation of semi-supervised learning. Our MTSS learns task-specific domain experts called teacher networks using the label embedding technique and learns a unified model called a student network by forcing a model to mimic the distributions learned by domain experts. Our experiments demonstrate that our method not only achieves competitive performance on various benchmarks for fashion attribute prediction, but also improves robustness and cross-domain adaptability for unseen domains.

📄 PDF Abstract BibTeX arXiv:2007.06769

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeMulti-Task Learning

Similar Papers 제목 키워드 기반

Flipped Classroom: Aligning Teacher Attention with Student in Generalized Category Discovery

2024-09-29 · Haonan Lin, Wenbin An, Jiahao Wang, Yan Chen 외

Recent advancements have shown promise in applying traditional Semi-Supervised Learning strategies to the task of Generalized Category Discovery (GCD). Typically, this involves a teacher-student framework in which the te…

JEDI: Joint Expert Distillation in a Semi-Supervised Multi-Dataset Student-Teacher Scenario for Video Action Recognition

2023-08-09 · Lucian Bicsi, Bogdan Alexe, Radu Tudor Ionescu, Marius Leordeanu

We propose JEDI, a multi-dataset semi-supervised learning method, which efficiently combines knowledge from multiple experts, learned on different datasets, to train and improve the performance of individual, per dataset…

Action RecognitionTemporal Action Localization

Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separation

2021-06-15 · Jisi Zhang, Catalin Zorila, Rama Doddipatla, Jon Barker

In this paper, we introduce a novel semi-supervised learning framework for end-to-end speech separation. The proposed method first uses mixtures of unseparated sources and the mixture invariant training (MixIT) criterion…

Speech Separation

Competitive Ensembling Teacher-Student Framework for Semi-Supervised Left Atrium MRI Segmentation

2023-10-21 · Yuyan Shi, Yichi Zhang, Shasha Wang

Semi-supervised learning has greatly advanced medical image segmentation since it effectively alleviates the need of acquiring abundant annotations from experts and utilizes unlabeled data which is much easier to acquire…

Image SegmentationLeft Atrium SegmentationMedical Image SegmentationMRI segmentation+3

MagicNet: Semi-Supervised Multi-Organ Segmentation via Magic-Cube Partition and Recovery

2022-12-29 · CVPR 2023 1 · Duowen Chen, Yunhao Bai, Wei Shen, Qingli Li 외

We propose a novel teacher-student model for semi-supervised multi-organ segmentation. In teacher-student model, data augmentation is usually adopted on unlabeled data to regularize the consistent training between teache…

AnatomyData AugmentationImage SegmentationMedical Image Segmentation+3