paper-with-me

Papers

Learning to Select Pre-Trained Deep Representations with Bayesian Evidence Framework

2015-06-08 · CVPR 2016 6 · Yong-Deok Kim, Taewoong Jang, Bohyung Han, Seungjin Choi

We propose a Bayesian evidence framework to facilitate transfer learning from pre-trained deep convolutional neural networks (CNNs). Our framework is formulated on top of a least squares SVM (LS-SVM) classifier, which is simple and fast in both training and testing, and achieves competitive performance in practice. The regularization parameters in LS-SVM is estimated automatically without grid search and cross-validation by maximizing evidence, which is a useful measure to select the best performing CNN out of multiple candidates for transfer learning; the evidence is optimized efficiently by employing Aitken's delta-squared process, which accelerates convergence of fixed point update. The proposed Bayesian evidence framework also provides a good solution to identify the best ensemble of heterogeneous CNNs through a greedy algorithm. Our Bayesian evidence framework for transfer learning is tested on 12 visual recognition datasets and illustrates the state-of-the-art performance consistently in terms of prediction accuracy and modeling efficiency.

📄 PDF Abstract BibTeX arXiv:1506.02565

Code (0)

등록된 구현이 없습니다.

Tasks

Transfer Learning

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

An image-computable model of speeded decision-making

2024-03-25 · Paul I. Jaffe, Gustavo X. Santiago-Reyes, Robert J. Schafer, Patrick G. Bissett 외

Evidence accumulation models (EAMs) are the dominant framework for modeling response time (RT) data from speeded decision-making tasks. While providing a good quantitative description of RT data in terms of abstract perc…

Decision Makingmodel

BOTS: A Unified Framework for Bayesian Online Task Selection in LLM Reinforcement Finetuning

2025-10-30 · Qianli Shen, Daoyuan Chen, Yilun Huang, Zhenqing Ling 외 arxiv

Reinforcement finetuning (RFT) is a key technique for aligning Large Language Models (LLMs) with human preferences and enhancing reasoning, yet its effectiveness is highly sensitive to which tasks are explored during tra…

Bayesian Inference

Bayesian Model Selection of Lithium-Ion Battery Models via Bayesian Quadrature

2022-10-28 · Masaki Adachi, Yannick Kuhn, Birger Horstmann, Arnulf Latz 외

A wide variety of battery models are available, and it is not always obvious which model `best' describes a dataset. This paper presents a Bayesian model selection approach using Bayesian quadrature. The model evidence i…

Model Selection

Bayesian Model Selection via Mean-Field Variational Approximation

2023-12-17 · Yangfan Zhang, Yun Yang

This article considers Bayesian model selection via mean-field (MF) variational approximation. Towards this goal, we study the non-asymptotic properties of MF inference under the Bayesian framework that allows latent var…

modelModel SelectionVariational Inference

Sparse Variational Bayesian Approximations for Nonlinear Inverse Problems: applications in nonlinear elastography

2014-12-01 · Isabell M. Franck, P. S. Koutsourelakis

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by …

Dimensionality ReductionMedical Diagnosis