Shallow Bayesian Meta Learning for Real-World Few-Shot Recognition
Current state-of-the-art few-shot learners focus on developing effective training procedures for feature representations, before using simple, e.g. nearest centroid, classifiers. In this paper, we take an orthogonal approach that is agnostic to the features used and focus exclusively on meta-learning the actual classifier layer. Specifically, we introduce MetaQDA, a Bayesian meta-learning generalization of the classic quadratic discriminant analysis. This setup has several benefits of interest to practitioners: meta-learning is fast and memory-efficient, without the need to fine-tune features. It is agnostic to the off-the-shelf features chosen and thus will continue to benefit from advances in feature representations. Empirically, it leads to robust performance in cross-domain few-shot learning and, crucially for real-world applications, it leads to better uncertainty calibration in predictions.
Code (2)
Tasks
Cross-Domain Few-Shotcross-domain few-shot learningFew-Shot Image ClassificationFew-Shot LearningMeta-LearningSimilar Papers 제목 키워드 기반
Bayesian task embedding for few-shot Bayesian optimization
We describe a method for Bayesian optimization by which one may incorporate data from multiple systems whose quantitative interrelationships are unknown a priori. All general (nonreal-valued) features of the systems are …
Bayesian InferenceBayesian OptimizationAdaptive Knowledge-Enhanced Bayesian Meta-Learning for Few-shot Event Detection
Event detection (ED) aims at detecting event trigger words in sentences and classifying them into specific event types. In real-world applications, ED typically does not have sufficient labelled data, thus can be formula…
DiversityEvent DetectionFew-Shot LearningMeta-LearningALPaCA vs. GP-based Prior Learning: A Comparison between two Bayesian Meta-Learning Algorithms
Meta-learning or few-shot learning, has been successfully applied in a wide range of domains from computer vision to reinforcement learning. Among the many frameworks proposed for meta-learning, bayesian methods are part…
Few-Shot LearningMeta-LearningReinforcement Learning (RL)Bayesian Meta-Learning for Few-Shot 3D Shape Completion
Estimating the 3D shape of real-world objects is a key perceptual challenge. It requires going from partial observations, which are often too sparse and incomprehensible for the human eye, to detailed shape representatio…
Meta-LearningObjectBayesian Online Meta-Learning
Neural networks are known to suffer from catastrophic forgetting when trained on sequential datasets. While there have been numerous attempts to solve this problem for large-scale supervised classification, little has be…
ClassificationMeta-LearningVariational Inference