Transfer Bayesian Meta-learning via Weighted Free Energy Minimization
Meta-learning optimizes the hyperparameters of a training procedure, such as its initialization, kernel, or learning rate, based on data sampled from a number of auxiliary tasks. A key underlying assumption is that the auxiliary tasks, known as meta-training tasks, share the same generating distribution as the tasks to be encountered at deployment time, known as meta-test tasks. This may, however, not be the case when the test environment differ from the meta-training conditions. To address shifts in task generating distribution between meta-training and meta-testing phases, this paper introduces weighted free energy minimization (WFEM) for transfer meta-learning. We instantiate the proposed approach for non-parametric Bayesian regression and classification via Gaussian Processes (GPs). The method is validated on a toy sinusoidal regression problem, as well as on classification using miniImagenet and CUB data sets, through comparison with standard meta-learning of GP priors as implemented by PACOH.
Code (1)
Tasks
Gaussian ProcessesMeta-LearningregressionSimilar Papers 제목 키워드 기반
Free energy and inference in living systems
Organisms are nonequilibrium, stationary systems self-organized via spontaneous symmetry breaking and undergoing metabolic cycles with broken detailed balance in the environment. The thermodynamic free-energy principle d…
Bayesian InferenceAn Equation for Predicting Binding Strengths of Metal Cations to Protein of Human Serum Transferrin
Because human serum transferrin (hTF) exists freely in serum, it is a potential target for cancer treatment drugs and in curing iron-overloaded conditions in patients via long-term transfusion therapy. The understanding …
A Bayesian approach for extracting free energy profiles from cryo-electron microscopy experiments using a path collective variable
Cryo-electron microscopy (cryo-EM) extracts single-particle density projections of individual biomolecules. Although cryo-EM is widely used for 3D reconstruction, due to its single-particle nature, it has the potential t…
3D ReconstructionBayesian InferenceRecursive Gaussian Processes and the Bayesian Brain
Predictive coding offers a powerful framework for cortical computation, yet scalable implementations that respect both Bayesian exactness and neurobiological constraints remain scarce. We bridge this gap by formally conn…
Gaussian ProcessesBayesian InferenceNishimori meets Bethe: a spectral method for node classification in sparse weighted graphs
This article unveils a new relation between the Nishimori temperature parametrizing a distribution P and the Bethe free energy on random Erdos-Renyi graphs with edge weights distributed according to P. Estimating the Nis…
Bayesian InferenceGeneral ClassificationNode ClassificationRelation