SaaS: Speed as a Supervisor for Semi-supervised Learning
We introduce the SaaS Algorithm for semi-supervised learning, which uses learning speed during stochastic gradient descent in a deep neural network to measure the quality of an iterative estimate of the posterior probability of unknown labels. Training speed in supervised learning correlates strongly with the percentage of correct labels, so we use it as an inference criterion for the unknown labels, without attempting to infer the model parameters at first. Despite its simplicity, SaaS achieves state-of-the-art results in semi-supervised learning benchmarks.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Segment Anything Across Shots: A Method and Benchmark
This work focuses on multi-shot semi-supervised video object segmentation (MVOS), which aims at segmenting the target object indicated by an initial mask throughout a video with multiple shots. The existing VOS methods m…
Semi-Supervised Video Object SegmentationData AugmentationSemi-Supervised Action Recognition with Temporal Contrastive Learning
Learning to recognize actions from only a handful of labeled videos is a challenging problem due to the scarcity of tediously collected activity labels. We approach this problem by learning a two-pathway temporal contras…
Action RecognitionContrastive LearningSalvage of Supervision in Weakly Supervised Object Detection
Weakly supervised object detection~(WSOD) has recently attracted much attention. However, the lack of bounding-box supervision makes its accuracy much lower than fully supervised object detection (FSOD), and currently mo…
Objectobject-detectionObject DetectionSemi-Supervised Object Detection+1Semi-Supervised Learning of Optical Flow by Flow Supervisor
A training pipeline for optical flow CNNs consists of a pretraining stage on a synthetic dataset followed by a fine tuning stage on a target dataset. However, obtaining ground truth flows from a target video requires a t…
Optical Flow EstimationSemi-Supervised Disparity Estimation with Deep Feature Reconstruction
Despite the success of deep learning in disparity estimation, the domain generalization gap remains an issue. We propose a semi-supervised pipeline that successfully adapts DispNet to a real-world domain by joint supervi…
Disparity EstimationDomain Generalization