Generalized Sparse Additive Model with Unknown Link Function

2024-10-08 · Peipei Yuan, Xinge You, Hong Chen, Xuelin Zhang, Qinmu Peng

Generalized additive models (GAM) have been successfully applied to high dimensional data analysis. However, most existing methods cannot simultaneously estimate the link function, the component functions and the variable interaction. To alleviate this problem, we propose a new sparse additive model, named generalized sparse additive model with unknown link function (GSAMUL), in which the component functions are estimated by B-spline basis and the unknown link function is estimated by a multi-layer perceptron (MLP) network. Furthermore, $\ell_{2,1}$-norm regularizer is used for variable selection. The proposed GSAMUL can realize both variable selection and hidden interaction. We integrate this estimation into a bilevel optimization problem, where the data is split into training set and validation set. In theory, we provide the guarantees about the convergence of the approximate procedure. In applications, experimental evaluations on both synthetic and real world data sets consistently validate the effectiveness of the proposed approach.

📄 PDF Abstract BibTeX arXiv:2410.06012

Code (0)

등록된 구현이 없습니다.

Tasks

Additive modelsBilevel OptimizationVariable Selection

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Classification by sparse generalized additive models

2022-12-04 · Felix Abramovich

We consider (nonparametric) sparse (generalized) additive models (SpAM) for classification. The design of a SpAM classifier is based on minimizing the logistic loss with a sparse group Lasso/Slope-type penalties on the c…

Additive models Classification

Learning Sparse Additive Models with Interactions in High Dimensions

2016-04-18 · Hemant Tyagi, Anastasios Kyrillidis, Bernd Gärtner, Andreas Krause

A function $f: \mathbb{R}^d \rightarrow \mathbb{R}$ is referred to as a Sparse Additive Model (SPAM), if it is of the form $f(\mathbf{x}) = \sum_{l \in \mathcal{S}}\phi_{l}(x_l)$, where $\mathcal{S} \subset [d]$, $|\math…

Additive models Vocal Bursts Intensity Prediction

Reluctant generalized additive modeling

2019-12-04 · J. Kenneth Tay, Robert Tibshirani

Sparse generalized additive models (GAMs) are an extension of sparse generalized linear models which allow a model's prediction to vary non-linearly with an input variable. This enables the data analyst build more accura…

Additive models

Multi-Source Transfer Learning of Sparse Single-Index Models

2026-06-28 · Ye Tian arxiv

Transfer learning leverages knowledge from related source domains to improve learning in a target domain. Recent theoretical advances cover a broad range of regression settings within (generalized) linear models. Despite…

Transfer Learning

Impulsive Noise Robust Sparse Recovery via Continuous Mixed Norm

2018-04-12 · Amirhossein Javaheri, Hadi Zayyani, Mario A. T. Figueiredo, Farrokh Marvasti

This paper investigates the problem of sparse signal recovery in the presence of additive impulsive noise. The heavytailed impulsive noise is well modelled with stable distributions. Since there is no explicit formulatio…