Semi-Supervised Learning by Label Gradient Alignment
We present label gradient alignment, a novel algorithm for semi-supervised learning which imputes labels for the unlabeled data and trains on the imputed labels. We define a semantically meaningful distance metric on the input space by mapping a point (x, y) to the gradient of the model at (x, y). We then formulate an optimization problem whose objective is to minimize the distance between the labeled and the unlabeled data in this space, and we solve it by gradient descent on the imputed labels. We evaluate label gradient alignment using the standardized architecture introduced by Oliver et al. (2018) and demonstrate state-of-the-art accuracy in semi-supervised CIFAR-10 classification.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationSimilar Papers 제목 키워드 기반
Learning from Noisy Preferences: A Semi-Supervised Learning Approach to Direct Preference Optimization
Human visual preferences are inherently multi-dimensional, encompassing aesthetics, detail fidelity, and semantic alignment. However, existing datasets provide only single, holistic annotations, resulting in severe label…
Decoupled Pseudo-labeling for Semi-Supervised Monocular 3D Object Detection
We delve into pseudo-labeling for semi-supervised monocular 3D object detection (SSM3OD) and discover two primary issues: a misalignment between the prediction quality of 3D and 2D attributes and the tendency of depth su…
3D Object DetectionMonocular 3D Object Detectionobject-detectionObject Detection+1Mutual- and Self- Prototype Alignment for Semi-supervised Medical Image Segmentation
Semi-supervised learning methods have been explored in medical image segmentation tasks due to the scarcity of pixel-level annotation in the real scenario. Proto-type alignment based consistency constraint is an intuitio…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1Deep Semi-supervised Metric Learning with Dual Alignment for Cervical Cancer Cell Detection
Deep learning has achieved unprecedented success in various object detection tasks with huge amounts of labeled data. However, obtaining large-scale annotations for medical images is extremely challenging due to the high…
Cell DetectionMetric Learningobject-detectionObject DetectionSemiGDA: Generative Dual-distribution Alignment for Semi-Supervised Medical Image Segmentation
Semi-supervised learning addresses label scarcity and high annotation costs in medical image segmentation by exploiting the latent information in unlabeled data to enhance model performance. Traditional discriminative se…
Semi-supervised Medical Image SegmentationRepresentation Learning