paper-with-me

Papers

Subset selection for linear mixed models

2021-07-27 · Daniel R. Kowal

Linear mixed models (LMMs) are instrumental for regression analysis with structured dependence, such as grouped, clustered, or multilevel data. However, selection among the covariates--while accounting for this structured dependence--remains a challenge. We introduce a Bayesian decision analysis for subset selection with LMMs. Using a Mahalanobis loss function that incorporates the structured dependence, we derive optimal linear coefficients for (i) any given subset of variables and (ii) all subsets of variables that satisfy a cardinality constraint. Crucially, these estimates inherit shrinkage or regularization and uncertainty quantification from the underlying Bayesian model, and apply for any well-specified Bayesian LMM. More broadly, our decision analysis strategy deemphasizes the role of a single "best" subset, which is often unstable and limited in its information content, and instead favors a collection of near-optimal subsets. This collection is summarized by key member subsets and variable-specific importance metrics. Customized subset search and out-of-sample approximation algorithms are provided for more scalable computing. These tools are applied to simulated data and a longitudinal physical activity dataset, and demonstrate excellent prediction, estimation, and selection ability.

📄 PDF Abstract BibTeX arXiv:2107.12890

Code (0)

등록된 구현이 없습니다.

Tasks

Uncertainty Quantification

Similar Papers 제목 키워드 기반

Feature subset selection for kernel SVM classification via mixed-integer optimization

2022-05-28 · Ryuta Tamura, Yuichi Takano, Ryuhei Miyashiro

We study the mixed-integer optimization (MIO) approach to feature subset selection in nonlinear kernel support vector machines (SVMs) for binary classification. First proposed for linear regression in the 1970s, this app…

Binary ClassificationComputational Efficiency

Piecewise-Linear Approximation for Feature Subset Selection in a Sequential Logit Model

2015-10-19 · Toshiki Sato, Yuichi Takano, Ryuhei Miyashiro

This paper concerns a method of selecting a subset of features for a sequential logit model. Tanaka and Nakagawa (2014) proposed a mixed integer quadratic optimization formulation for solving the problem based on a quadr…

Automated Model Selection for Generalized Linear Models

2024-04-25 · Benjamin Schwendinger, Florian Schwendinger, Laura Vana-Gür

In this paper, we show how mixed-integer conic optimization can be used to combine feature subset selection with holistic generalized linear models to fully automate the model selection process. Concretely, we directly o…

feature selectionmodelModel Selectionregression

Scalable Subset Selection in Linear Mixed Models

2025-06-25 · Ryan Thompson, Matt P. Wand, Joanna J. J. Wang

Linear mixed models (LMMs), which incorporate fixed and random effects, are key tools for analyzing heterogeneous data, such as in personalized medicine or adaptive marketing. Nowadays, this type of data is increasingly …

MarketingSparse Learning

Subset Selection with Shrinkage: Sparse Linear Modeling when the SNR is low

2017-08-10 · Rahul Mazumder, Peter Radchenko, Antoine Dedieu

We study a seemingly unexpected and relatively less understood overfitting aspect of a fundamental tool in sparse linear modeling - best subset selection, which minimizes the residual sum of squares subject to a constrai…

regressionSparse Learning