Generalized Additive Model Selection
We introduce GAMSEL (Generalized Additive Model Selection), a penalized likelihood approach for fitting sparse generalized additive models in high dimension. Our method interpolates between null, linear and additive models by allowing the effect of each variable to be estimated as being either zero, linear, or a low-complexity curve, as determined by the data. We present a blockwise coordinate descent procedure for efficiently optimizing the penalized likelihood objective over a dense grid of the tuning parameter, producing a regularization path of additive models. We demonstrate the performance of our method on both real and simulated data examples, and compare it with existing techniques for additive model selection.
Code (0)
등록된 구현이 없습니다.
Tasks
Additive modelsmodelModel SelectionSimilar Papers 제목 키워드 기반
Generalized Sparse Additive Model with Unknown Link Function
Generalized additive models (GAM) have been successfully applied to high dimensional data analysis. However, most existing methods cannot simultaneously estimate the link function, the component functions and the variabl…
Additive modelsBilevel OptimizationVariable SelectionAutoML Algorithms for Online Generalized Additive Model Selection: Application to Electricity Demand Forecasting
Electricity demand forecasting is key to ensuring that supply meets demand lest the grid would blackout. Reliable short-term forecasts may be obtained by combining a Generalized Additive Models (GAM) with a State-Space m…
Additive modelsAutoMLDemand ForecastingModel Selection+1Generalized Groves of Neural Additive Models: Pursuing transparent and accurate machine learning models in finance
While machine learning methods have significantly improved model performance over traditional methods, their black-box structure makes it difficult for researchers to interpret results. For highly regulated financial ind…
Additive modelsFairnessInterpretable Machine LearningSpike-and-Slab LASSO Generalized Additive Models and Scalable Algorithms for High-Dimensional Data Analysis
There are proposals that extend the classical generalized additive models (GAMs) to accommodate high-dimensional data ($p>>n$) using group sparse regularization. However, the sparse regularization may induce excess shrin…
Additive modelsTowards Bayesian Data Selection
A wide range of machine learning algorithms iteratively add data to the training sample. Examples include semi-supervised learning, active learning, multi-armed bandits, and Bayesian optimization. We embed this kind of d…
Active LearningAdditive modelsBayesian OptimizationMulti-Armed Bandits