paper-with-me

Papers

Cluster-Based Generalized Additive Models Informed by Random Fourier Features

2025-12-22 · Xin Huang, Jia Li, Jun Yu arxiv

In developing data-driven modeling methodologies, there is an ongoing need to reconcile the strong predictive performance of opaque black-box models with the transparency required for critical applications. This work introduces an interpretable and computationally tractable regression framework for heterogeneous data by combining response-informed spectral representation learning with localized additive modeling. The method first fits a random Fourier feature regression model and constructs a spectral feature map from the learned amplitudes and adaptively resampled frequencies, so that the representation reflects predictive variation in the data. This representation is then compressed by principal component analysis to obtain a low-dimensional latent embedding, in which a Gaussian mixture model performs soft regime discovery. Within each regime, a cluster-specific generalized additive model captures nonlinear covariate effects through interpretable spline-based univariate smooth functions. The final predictor is formed as a soft mixture of these local additive models, enabling flexible modeling of a nonlinear, heterogeneous structure while preserving interpretability. Numerical experiments across several benchmark regression datasets show that the proposed method consistently improves upon classical globally interpretable baselines while remaining competitive with more flexible black-box models. Overall, the framework provides a unified approach to heterogeneous regression that combines predictive adaptivity with interpretable local covariate effects.

📄 PDF Abstract BibTeX arXiv:2512.19373

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Classification by sparse generalized additive models

2022-12-04 · Felix Abramovich

We consider (nonparametric) sparse (generalized) additive models (SpAM) for classification. The design of a SpAM classifier is based on minimizing the logistic loss with a sparse group Lasso/Slope-type penalties on the c…

Additive modelsClassification

Fast kernel methods: Sobolev, physics-informed, and additive models

2025-09-02 · Nathan Doumèche, Francis Bach, Gérard Biau, Claire Boyer arxiv

Kernel methods are powerful tools in statistical learning, but their cubic complexity in the sample size n limits their use on large-scale datasets. In this work, we introduce a scalable framework for kernel regression w…

Additive Bayesian Network Modelling with the R Package abn

2019-11-20 · Gilles Kratzer, Fraser Iain Lewis, Arianna Comin, Marta Pittavino 외

The R package abn is designed to fit additive Bayesian models to observational datasets. It contains routines to score Bayesian networks based on Bayesian or information theoretic formulations of generalized linear model…

Clustering

Multiattribute Auctions Based on Generalized Additive Independence

2014-01-16 · Yagil Engel, Michael P. Wellman

We develop multiattribute auctions that accommodate generalized additive independent (GAI) preferences. We propose an iterative auction mechanism that maintains prices on potentially overlapping GAI clusters of attribute…

The Generalized Fourier Transform: A Unified Framework for the Fourier, Laplace, Mellin and $Z$ Transforms

2021-02-12 · Pushpendra Singh, Anubha Gupta, Shiv Dutt Joshi

This paper introduces Generalized Fourier transform (GFT) that is an extension or the generalization of the Fourier transform (FT). The Unilateral Laplace transform (LT) is observed to be the special case of GFT. GFT, as…