Data-Efficient Challenges in Visual Inductive Priors: A Retrospective
Deep Learning requires large amounts of data to train models that work well. In data-deficient settings, performance can be degraded. We investigate which Deep Learning methods benefit training models in a data-deficient setting, by organizing the "VIPriors: Visual Inductive Priors for Data-Efficient Deep Learning" workshop series, featuring four editions of data-impaired challenges. These challenges address the problem of training deep learning models for computer vision tasks with limited data. Participants are limited to training models from scratch using a low number of training samples and are not allowed to use any form of transfer learning. We aim to stimulate the development of novel approaches that incorporate prior knowledge to improve the data efficiency of deep learning models. Successful challenge entries make use of large model ensembles that mix Transformers and CNNs, as well as heavy data augmentation. Novel prior knowledge-based methods contribute to success in some entries.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDeep LearningTransfer LearningSimilar Papers 제목 키워드 기반
VIPriors 2: Visual Inductive Priors for Data-Efficient Deep Learning Challenges
The second edition of the "VIPriors: Visual Inductive Priors for Data-Efficient Deep Learning" challenges featured five data-impaired challenges, where models are trained from scratch on a reduced number of training samp…
Data AugmentationDeep LearningTransfer LearningVIPriors 1: Visual Inductive Priors for Data-Efficient Deep Learning Challenges
We present the first edition of "VIPriors: Visual Inductive Priors for Data-Efficient Deep Learning" challenges. We offer four data-impaired challenges, where models are trained from scratch, and we reduce the number of …
Action RecognitionData AugmentationDeep LearningImage Classification+3VIPriors 4: Visual Inductive Priors for Data-Efficient Deep Learning Challenges
The fourth edition of the "VIPriors: Visual Inductive Priors for Data-Efficient Deep Learning" workshop features two data-impaired challenges. These challenges address the problem of training deep learning models for com…
Data AugmentationDeep LearningTransfer LearningVIPriors 3: Visual Inductive Priors for Data-Efficient Deep Learning Challenges
The third edition of the "VIPriors: Visual Inductive Priors for Data-Efficient Deep Learning" workshop featured four data-impaired challenges, focusing on addressing the limitations of data availability in training deep …
Data AugmentationDeep LearningRepresentation LearningTransfer LearningTask-Specific Data Augmentation and Inference Processing for VIPriors Instance Segmentation Challenge
Instance segmentation is applied widely in image editing, image analysis and autonomous driving, etc. However, insufficient data is a common problem in practical applications. The Visual Inductive Priors(VIPriors) Instan…
Autonomous DrivingData AugmentationInstance SegmentationSegmentation+1