paper-with-me

Papers

Automatic knot selection in smooth additive models

2026-07-23 · Nicolás Carrizosa, Vanesa Guerrero, María Durbán arxiv

B-spline regression constitutes a widely used framework for nonparametric modeling. The performance of this methodology depends on specifying the number and placement of changepoints, known as knots, prior to the estimation process. Such knot sequence determines the dimension of the B-spline basis used to represent the regression function and the number of coefficients to be estimated. Therefore, the knots' choice affects the model's flexibility, influencing its smoothness and goodness-of-fit. Traditionally, this problem has been addressed either by explicitly selecting knots, via knot-selection algorithms, or by regularization methods, such as P-splines, which automatically tune the regressor's smoothness. The latter have become the standard in generalized additive models (GAMs). In contrast, knot-selection techniques, frequently neglected because of computational or modeling limitations, provide certain advantages which can be valuable in some contexts. In this work, we introduce a novel explicit knot-selection technique for GAMs based on an extension of the adaptive splines (A-splines) knot selection methodology, combined with a customized Fellner-Schall scheme for tuning the associated parameters. Our approach is evaluated on various synthetic and real datasets and compared with P-splines and state-of-the-art knot-selection techniques. The results indicate comparable performance, while producing models built on a substantially smaller number of basis elements.

📄 PDF Abstract BibTeX arXiv:2607.21083

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On the Rate of Convergence of Kolmogorov-Arnold Network Regression Estimators

2025-09-24 · Wei Liu, Eleni Chatzi, Zhilu Lai arxiv

Kolmogorov-Arnold Networks (KANs) approximate multivariate functions by composing univariate transformations through additive or multiplicative aggregation. We establish convergence guarantees for KANs whose univariate c…

Spline Dimensional Decomposition with Interpolation-based Optimal Knot Selection for Stochastic Dynamic Analysis

2025-05-19 · Yeonsu Kim, Junhan Lee, John T. Hwang, Bingran Wang 외

Forward uncertainty quantification in dynamic systems is challenging due to non-smooth or locally oscillating nonlinear behaviors. Spline dimensional decomposition (SDD) effectively addresses such nonlinearity by partiti…

Uncertainty Quantification

Adaptive spline fitting with particle swarm optimization

2019-07-28 · Soumya D. Mohanty, Ethan Fahnestock

In fitting data with a spline, finding the optimal placement of knots can significantly improve the quality of the fit. However, the challenging high-dimensional and non-convex optimization problem associated with comple…

ClusteringModel Selection

Knot Selection in Sparse Gaussian Processes

2020-02-21 · Nathaniel Garton, Jarad Niemi, Alicia Carriquiry

Knot-based, sparse Gaussian processes have enjoyed considerable success as scalable approximations to full Gaussian processes. Problems can occur, however, when knot selection is done by optimizing the marginal likelihoo…

Bayesian OptimizationGaussian Processes

Fast Automatic Smoothing for Generalized Additive Models

2018-09-25 · Yousra El-Bachir, Anthony C. Davison

Multiple generalized additive models (GAMs) are a type of distributional regression wherein parameters of probability distributions depend on predictors through smooth functions, with selection of the degree of smoothnes…

Additive models