Training with Growing Sets: A Simple Alternative to Curriculum Learning and Self Paced Learning
Curriculum learning and Self paced learning are popular topics in the machine learning that suggest to put the training samples in order by considering their difficulty levels. Studies in these topics show that starting with a small training set and adding new samples according to difficulty levels improves the learning performance. In this paper we experimented that we can also obtain good results by adding the samples randomly without a meaningful order. We compared our method with classical training, Curriculum learning, Self paced learning and their reverse ordered versions. Results of the statistical tests show that the proposed method is better than classical method and similar with the others. These results point a new training regime that removes the process of difficulty level determination in Curriculum and Self paced learning and as successful as these methods.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Progressive Growing of Patch Size: Resource-Efficient Curriculum Learning for Dense Prediction Tasks
In this work, we introduce Progressive Growing of Patch Size, a resource-efficient implicit curriculum learning approach for dense prediction tasks. Our curriculum approach is defined by growing the patch size during mod…
Task Progressive Curriculum Learning for Robust Visual Question Answering
Visual Question Answering (VQA) systems are known for their poor performance in out-of-distribution datasets. An issue that was addressed in previous works through ensemble learning, answer re-ranking, or artificially gr…
Data AugmentationEnsemble LearningQuestion AnsweringRe-Ranking+2Progressive Growing of Patch Size: Curriculum Learning for Accelerated and Improved Medical Image Segmentation
In this work, we introduce Progressive Growing of Patch Size, an automatic curriculum learning approach for 3D medical image segmentation. Our approach progressively increases the patch size during model training, result…
Medical Image SegmentationLesion SegmentationSpatial Transformer Networks for Curriculum Learning
Curriculum learning is a bio-inspired training technique that is widely adopted to machine learning for improved optimization and better training of neural networks regarding the convergence rate or obtained accuracy. Th…
image-classificationImage ClassificationLearning to Solve Complex Problems via Dataset Decomposition
Curriculum learning is a class of training strategies that organizes the data being exposed to a model by difficulty, gradually from simpler to more complex examples. This research explores a reverse curriculum generatio…
Code Generation