paper-with-me

Papers

Bayesian Kernel Regression for Functional Data

2025-03-17 · Minoru Kusaba, Megumi Iwayama, Ryo Yoshida

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this study, we propose a novel functional output regression model based on kernel methods. Unlike conventional approaches that independently train regressors with scalar outputs for each measurement point of the output function, our method leverages the covariance structure within the function values, akin to multitask learning, leading to enhanced learning efficiency and improved prediction accuracy. Compared with existing nonlinear function-on-scalar models in statistical functional data analysis, our model effectively handles high-dimensional nonlinearity while maintaining a simple model structure. Furthermore, the fully kernel-based formulation allows the model to be expressed within the framework of reproducing kernel Hilbert space (RKHS), providing an analytic form for parameter estimation and a solid foundation for further theoretical analysis. The proposed model delivers a functional output predictive distribution derived analytically from a Bayesian perspective, enabling the quantification of uncertainty in the predicted function. We demonstrate the model's enhanced prediction performance through experiments on artificial datasets and density of states prediction tasks in materials science.

📄 PDF Abstract BibTeX arXiv:2503.13676

Code (0)

등록된 구현이 없습니다.

Tasks

parameter estimationregression

Similar Papers 제목 키워드 기반

Bayesian Additive Distribution Regression

2026-03-06 · Antonio R. Linero, Soumyabrata Bose, Jared Murray arxiv

Distribution regression, where the goal is to predict a scalar response from a distribution-valued predictor, arises naturally in settings where observations are grouped and outcomes depend on group-level characteristics…

Computational Efficiency

Equivalence of Convergence Rates of Posterior Distributions and Bayes Estimators for Functions and Nonparametric Functionals

2020-11-27 · Zejian Liu, Meng Li

We study the posterior contraction rates of a Bayesian method with Gaussian process priors in nonparametric regression and its plug-in property for differential operators. For a general class of kernels, we establish con…

Gaussian Processesregression

DR-ABC: Approximate Bayesian Computation with Kernel-Based Distribution Regression

2016-02-15 · Jovana Mitrovic, Dino Sejdinovic, Yee Whye Teh

Performing exact posterior inference in complex generative models is often difficult or impossible due to an expensive to evaluate or intractable likelihood function. Approximate Bayesian computation (ABC) is an inferenc…

regression

Kernel Functional Optimisation

2021-12-01 · NeurIPS 2021 12 · Arun Kumar Anjanapura Venkatesh, Alistair Shilton, Santu Rana, Sunil Gupta 외

Traditional methods for kernel selection rely on parametric kernel functions or a combination thereof and although the kernel hyperparameters are tuned, these methods often provide sub-optimal results due to the limitati…

Bayesian Optimisation

Notes on Kernel Methods in Machine Learning

2025-11-18 · Diego Armando Pérez-Rosero, Danna Valentina Salazar-Dubois, Juan Camilo Lugo-Rojas, Andrés Marino Álvarez-Meza 외 arxiv

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernel…

Density EstimationBayesian InferenceGaussian Processes