paper-with-me

Papers

Scalable Higher-Order Tensor Product Spline Models

2024-02-02 · David Rügamer

In the current era of vast data and transparent machine learning, it is essential for techniques to operate at a large scale while providing a clear mathematical comprehension of the internal workings of the method. Although there already exist interpretable semi-parametric regression methods for large-scale applications that take into account non-linearity in the data, the complexity of the models is still often limited. One of the main challenges is the absence of interactions in these models, which are left out for the sake of better interpretability but also due to impractical computational costs. To overcome this limitation, we propose a new approach using a factorization method to derive a highly scalable higher-order tensor product spline model. Our method allows for the incorporation of all (higher-order) interactions of non-linear feature effects while having computational costs proportional to a model without interactions. We further develop a meaningful penalization scheme and examine the induced optimization problem. We conclude by evaluating the predictive and estimation performance of our method.

📄 PDF Abstract BibTeX arXiv:2402.01090

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Additive Higher-Order Factorization Machines

2022-05-28 · David Rügamer

In the age of big data and interpretable machine learning, approaches need to work at scale and at the same time allow for a clear mathematical understanding of the method's inner workings. While there exist inherently i…

Interpretable Machine Learning

Sketching for Kronecker Product Regression and P-splines

2017-12-27 · Huaian Diao, Zhao Song, Wen Sun, David P. Woodruff

TensorSketch is an oblivious linear sketch introduced in Pagh'13 and later used in Pham, Pagh'13 in the context of SVMs for polynomial kernels. It was shown in Avron, Nguyen, Woodruff'14 that TensorSketch provides a subs…

regression

SplineFlow: Flow Matching for Dynamical Systems with B-Spline Interpolants

2026-01-30 · Santanu Subhash Rathod, Pietro Liò, Xiao Zhang arxiv

Flow matching is a scalable generative framework for characterizing continuous normalizing flows with wide-range applications. However, current state-of-the-art methods are not well-suited for modeling dynamical systems,…

Matrix Product State for Feature Extraction of Higher-Order Tensors

2015-03-02 · Johann A. Bengua, Ho N. Phien, Hoang D. Tuan, Minh N. Do

This paper introduces matrix product state (MPS) decomposition as a computational tool for extracting features of multidimensional data represented by higher-order tensors. Regardless of tensor order, MPS extracts its re…

General Classification

Multivariate Trend Filtering for Lattice Data

2021-12-29 · Veeranjaneyulu Sadhanala, Yu-Xiang Wang, Addison J. Hu, Ryan J. Tibshirani

We study a multivariate version of trend filtering, called Kronecker trend filtering or KTF, for the case in which the design points form a lattice in $d$ dimensions. KTF is a natural extension of univariate trend filter…