Few-shot Classification via Ensemble Learning with Multi-Order Statistics
Transfer learning has been widely adopted for few-shot classification. Recent studies reveal that obtaining good generalization representation of images on novel classes is the key to improving the few-shot classification accuracy. To address this need, we prove theoretically that leveraging ensemble learning on the base classes can correspondingly reduce the true error in the novel classes. Following this principle, a novel method named Ensemble Learning with Multi-Order Statistics (ELMOS) is proposed in this paper. In this method, after the backbone network, we use multiple branches to create the individual learners in the ensemble learning, with the goal to reduce the storage cost. We then introduce different order statistics pooling in each branch to increase the diversity of the individual learners. The learners are optimized with supervised losses during the pre-training phase. After pre-training, features from different branches are concatenated for classifier evaluation. Extensive experiments demonstrate that each branch can complement the others and our method can produce a state-of-the-art performance on multiple few-shot classification benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDiversityEnsemble LearningTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Calibrating Higher-Order Statistics for Few-Shot Class-Incremental Learning with Pre-trained Vision Transformers
Few-shot class-incremental learning (FSCIL) aims to adapt the model to new classes from very few data (5 samples) without forgetting the previously learned classes. Recent works in many-shot CIL (MSCIL) (using all availa…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning+2Closed-Form Beta Distribution Estimation from Sparse Statistics with Random Forest Implicit Regularization
This work advances distribution recovery from sparse data and ensemble classification through three main contributions. First, we introduce a closed-form estimator that reconstructs scaled beta distributions from limited…
KGTN-ens: Few-Shot Image Classification with Knowledge Graph Ensembles
We propose KGTN-ens, a framework extending the recent Knowledge Graph Transfer Network (KGTN) in order to incorporate multiple knowledge graph embeddings at a small cost. We evaluate it with different combinations of emb…
Few-Shot Image Classificationimage-classificationImage ClassificationKnowledge Graph EmbeddingsOn Last-Layer Algorithms for Classification: Decoupling Representation from Uncertainty Estimation
Uncertainty quantification for deep learning is a challenging open problem. Bayesian statistics offer a mathematically grounded framework to reason about uncertainties; however, approximate posteriors for modern neural n…
General ClassificationRepresentation LearningUncertainty QuantificationHeartbeat classification fusing temporal and morphological information of ECGs via ensemble of classifiers
A method for the automatic classification of electrocardiograms (ECG) based on the combination of multiple Support Vector Machines (SVMs) is presented in this work. The method relies on the time intervals between consequ…
Electrocardiography (ECG)General ClassificationHeartbeat Classification