paper-with-me

홈 › Papers

Optimal Bayesian Transfer Learning

2018-01-02 · Alireza Karbalayghareh, Xiaoning Qian, Edward R. Dougherty

Transfer learning has recently attracted significant research attention, as it simultaneously learns from different source domains, which have plenty of labeled data, and transfers the relevant knowledge to the target domain with limited labeled data to improve the prediction performance. We propose a Bayesian transfer learning framework where the source and target domains are related through the joint prior density of the model parameters. The modeling of joint prior densities enables better understanding of the "transferability" between domains. We define a joint Wishart density for the precision matrices of the Gaussian feature-label distributions in the source and target domains to act like a bridge that transfers the useful information of the source domain to help classification in the target domain by improving the target posteriors. Using several theorems in multivariate statistics, the posteriors and posterior predictive densities are derived in closed forms with hypergeometric functions of matrix argument, leading to our novel closed-form and fast Optimal Bayesian Transfer Learning (OBTL) classifier. Experimental results on both synthetic and real-world benchmark data confirm the superb performance of the OBTL compared to the other state-of-the-art transfer learning and domain adaptation methods.

📄 PDF Abstract BibTeX arXiv:1801.00857

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationTransfer Learning

Similar Papers 제목 키워드 기반

Bayesian Transfer Learning

2023-12-20 · Piotr M. Suder, Jason Xu, David B. Dunson

Transfer learning is a burgeoning concept in statistical machine learning that seeks to improve inference and/or predictive accuracy on a domain of interest by leveraging data from related domains. While the term "transf…

Electrical EngineeringTransfer Learning

Data-driven Prior Learning for Bayesian Optimisation

2023-11-24 · Sigrid Passano Hellan, Christopher G. Lucas, Nigel H. Goddard

Transfer learning for Bayesian optimisation has generally assumed a strong similarity between optimisation tasks, with at least a subset having similar optimal inputs. This assumption can reduce computational costs, but …

Bayesian OptimisationTransfer Learning

Robust Importance Sampling for Error Estimation in the Context of Optimal Bayesian Transfer Learning

2021-09-05 · Omar Maddouri, Xiaoning Qian, Francis J. Alexander, Edward R. Dougherty 외

Classification has been a major task for building intelligent systems as it enables decision-making under uncertainty. Classifier design aims at building models from training data for representing feature-label distribut…

ClassificationDecision MakingDecision Making Under UncertaintyTransfer Learning

Fully probabilistic design for knowledge fusion between Bayesian filters under uniform disturbances

2021-09-22 · Lenka Kuklišová Pavelková, Ladislav Jirsa, Anthony Quinn

This paper considers the problem of Bayesian transfer learning-based knowledge fusion between linear state-space processes driven by uniform state and observation noise processes. The target task conditions on probabilis…

Decision MakingTransfer Learning

A Variational Bayesian Approach to Learning Latent Variables for Acoustic Knowledge Transfer

2021-10-16 · Hu Hu, Sabato Marco Siniscalchi, Chao-Han Huck Yang, Chin-Hui Lee

We propose a variational Bayesian (VB) approach to learning distributions of latent variables in deep neural network (DNN) models for cross-domain knowledge transfer, to address acoustic mismatches between training and t…

Acoustic Scene ClassificationScene ClassificationTransfer Learning