paper-with-me

Papers

Meta Learning for High-dimensional Ising Model Selection Using $\ell_1$-regularized Logistic Regression

2022-08-19 · Huiming Xie, Jean Honorio

In this paper, we consider the meta learning problem for estimating the graphs associated with high-dimensional Ising models, using the method of $\ell_1$-regularized logistic regression for neighborhood selection of each node. Our goal is to use the information learned from the auxiliary tasks in the learning of the novel task to reduce its sufficient sample complexity. To this end, we propose a novel generative model as well as an improper estimation method. In our setting, all the tasks are \emph{similar} in their \emph{random} model parameters and supports. By pooling all the samples from the auxiliary tasks to \emph{improperly} estimate a single parameter vector, we can recover the true support union, assumed small in size, with a high probability with a sufficient sample complexity of $\Omega(1) $ per task, for $K = \Omega(d^3 \log p ) $ tasks of Ising models with $p$ nodes and a maximum neighborhood size $d$. Then, with the support for the novel task restricted to the estimated support union, we prove that consistent neighborhood selection for the novel task can be obtained with a reduced sufficient sample complexity of $\Omega(d^3 \log d)$.

📄 PDF Abstract BibTeX arXiv:2208.09539

Code (0)

등록된 구현이 없습니다.

Tasks

Meta-LearningModel Selectionregression

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

Regularized Meta-Learning for Improved Generalization

2026-02-12 · Noor Islam S. Mohammad, Md Muntaqim Meherab arxiv

Deep ensemble methods often improve predictive performance, yet they suffer from three practical limitations: redundancy among base models that inflates computational cost and degrades conditioning, unstable weighting un…

On model selection consistency of regularized M-estimators

2013-05-31 · Jason D. Lee, Yuekai Sun, Jonathan E. Taylor

Regularized M-estimators are used in diverse areas of science and engineering to fit high-dimensional models with some low-dimensional structure. Usually the low-dimensional structure is encoded by the presence of the (u…

modelModel Selection

Closed-form Estimators for High-dimensional Generalized Linear Models

2015-12-01 · NeurIPS 2015 12 · Eunho Yang, Aurelie C. Lozano, Pradeep K. Ravikumar

We propose a class of closed-form estimators for GLMs under high-dimensional sampling regimes. Our class of estimators is based on deriving closed-form variants of the vanilla unregularized MLE but which are (a) well-def…

FormVariable SelectionVocal Bursts Intensity Prediction

Representer Point Selection for Explaining Regularized High-dimensional Models

2023-05-31 · Che-Ping Tsai, Jiong Zhang, Eli Chien, Hsiang-Fu Yu 외

We introduce a novel class of sample-based explanations we term high-dimensional representers, that can be used to explain the predictions of a regularized high-dimensional model in terms of importance weights for each o…

Binary ClassificationCollaborative FilteringRecommendation Systems

Fast Bayesian Feature Selection for High Dimensional Linear Regression in Genomics via the Ising Approximation

2014-07-30 · Charles K. Fisher, Pankaj Mehta

Feature selection, identifying a subset of variables that are relevant for predicting a response, is an important and challenging component of many methods in statistics and machine learning. Feature selection is especia…

feature selectionregression