Classification by sparse generalized additive models
We consider (nonparametric) sparse (generalized) additive models (SpAM) for classification. The design of a SpAM classifier is based on minimizing the logistic loss with a sparse group Lasso/Slope-type penalties on the coefficients of univariate additive components' expansions in orthonormal series (e.g., Fourier or wavelets). The resulting classifier is inherently adaptive to the unknown sparsity and smoothness. We show that under certain sparse group restricted eigenvalue condition it is nearly-minimax (up to log-factors) simultaneously across the entire range of analytic, Sobolev and Besov classes. The performance of the proposed classifier is illustrated on a simulated and a real-data examples.
Code (0)
등록된 구현이 없습니다.
Tasks
Additive modelsClassificationSimilar Papers 제목 키워드 기반
Reluctant generalized additive modeling
Sparse generalized additive models (GAMs) are an extension of sparse generalized linear models which allow a model's prediction to vary non-linearly with an input variable. This enables the data analyst build more accura…
Additive modelsFast Sparse Classification for Generalized Linear and Additive Models
We present fast classification techniques for sparse generalized linear and additive models. These techniques can handle thousands of features and thousands of observations in minutes, even in the presence of many highly…
Additive modelsClassificationGeneralized Additive Model Selection
We introduce GAMSEL (Generalized Additive Model Selection), a penalized likelihood approach for fitting sparse generalized additive models in high dimension. Our method interpolates between null, linear and additive mode…
Additive modelsmodelModel SelectionGeneralized Sparse Additive Model with Unknown Link Function
Generalized additive models (GAM) have been successfully applied to high dimensional data analysis. However, most existing methods cannot simultaneously estimate the link function, the component functions and the variabl…
Additive modelsBilevel OptimizationVariable SelectionFlagGAM: Rule-Basis Generalized Additive Models for Explainable Tabular Prediction
Tabular applications often require inspectable prediction rules and stable behavior when records are incomplete. We propose FlagGAM, a rule-basis framework that separates feature-level rule construction from prediction. …