Optimal prediction for kernel-based semi-functional linear regression
In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that the smoother functional component can be learned with the minimax rate as if the nonparametric component were known. More specifically, a double-penalized least squares method is adopted to estimate both the functional and nonparametric components within the framework of reproducing kernel Hilbert spaces. By virtue of the representer theorem, an efficient algorithm that requires no iterations is proposed to solve the corresponding optimization problem, where the regularization parameters are selected by the generalized cross validation criterion. Numerical studies are provided to demonstrate the effectiveness of the method and to verify the theoretical analysis.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionregressionSimilar Papers 제목 키워드 기반
Kernel-based off-policy estimation without overlap: Instance optimality beyond semiparametric efficiency
We study optimal procedures for estimating a linear functional based on observational data. In many problems of this kind, a widely used assumption is strict overlap, i.e., uniform boundedness of the importance ratio, wh…
regressionNon-asymptotic Optimal Prediction Error for Growing-dimensional Partially Functional Linear Models
Under the reproducing kernel Hilbert spaces (RKHS), we consider the penalized least-squares of the partially functional linear models (PFLM), whose predictor contains both functional and traditional multivariate parts, a…
PredictionStatistical Optimality of Divide and Conquer Kernel-based Functional Linear Regression
Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence p…
regressionEstimation of Integrated Volatility Functionals with Kernel Spot Volatility Estimators
For a multidimensional It\^o semimartingale, we consider the problem of estimating integrated volatility functionals. Jacod and Rosenbaum (2013) studied a plug-in type of estimator based on a Riemann sum approximation of…
A Specialized Semismooth Newton Method for Kernel-Based Optimal Transport
Kernel-based optimal transport (OT) estimators offer an alternative, functional estimation procedure to address OT problems from samples. Recent works suggest that these estimators are more statistically efficient than p…