Improving task-specific representation via 1M unlabelled images without any extra knowledge
We present a case-study to improve the task-specific representation by leveraging a million unlabelled images without any extra knowledge. We propose an exceedingly simple method of conditioning an existing representation on a diverse data distribution and observe that a model trained on diverse examples acts as a better initialization. We extensively study our findings for the task of surface normal estimation and semantic segmentation from a single image. We improve surface normal estimation on NYU-v2 depth dataset and semantic segmentation on PASCAL VOC by 4% over base model. We did not use any task-specific knowledge or auxiliary tasks, neither changed hyper-parameters nor made any modification in the underlying neural network architecture.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationSemantic SegmentationSurface Normal EstimationSimilar Papers 제목 키워드 기반
Learning Semi-supervised Gaussian Mixture Models for Generalized Category Discovery
In this paper, we address the problem of generalized category discovery (GCD), \ie, given a set of images where part of them are labelled and the rest are not, the task is to automatically cluster the images in the unlab…
Contrastive Learningimage-classificationImage ClassificationObject Recognition+1A foundation model for generalizable disease diagnosis in chest X-ray images
Medical artificial intelligence (AI) is revolutionizing the interpretation of chest X-ray (CXR) images by providing robust tools for disease diagnosis. However, the effectiveness of these AI models is often limited by th…
Self-Supervised LearningBlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images
We present BlockGAN, an image generative model that learns object-aware 3D scene representations directly from unlabelled 2D images. Current work on scene representation learning either ignores scene background or treats…
3D geometryObjectRepresentation LearningDon't Wait, Just Weight: Improving Unsupervised Representations by Learning Goal-Driven Instance Weights
In the absence of large labelled datasets, self-supervised learning techniques can boost performance by learning useful representations from unlabelled data, which is often more readily available. However, there is often…
Meta-LearningSelf-Supervised LearningDon’t Wait, Just Weight: Improving Unsupervised Representations by Learning Goal-Driven Instance Weights
In the absence of large labelled datasets, self-supervised learning techniques can boost performance by learning useful representations from unlabelled data, which is often more readily available. However, there is oft…
Image ClassificationMeta-LearningSelf-Supervised Learning