paper-with-me

홈 › Papers

Group-Sparse Model Selection: Hardness and Relaxations

2013-03-13 · Luca Baldassarre, Nirav Bhan, Volkan Cevher, Anastasios Kyrillidis, Siddhartha Satpathi

Group-based sparsity models are proven instrumental in linear regression problems for recovering signals from much fewer measurements than standard compressive sensing. The main promise of these models is the recovery of "interpretable" signals through the identification of their constituent groups. In this paper, we establish a combinatorial framework for group-model selection problems and highlight the underlying tractability issues. In particular, we show that the group-model selection problem is equivalent to the well-known NP-hard weighted maximum coverage problem (WMC). Leveraging a graph-based understanding of group models, we describe group structures which enable correct model selection in polynomial time via dynamic programming. Furthermore, group structures that lead to totally unimodular constraints have tractable discrete as well as convex relaxations. We also present a generalization of the group-model that allows for within group sparsity, which can be used to model hierarchical sparsity. Finally, we study the Pareto frontier of group-sparse approximations for two tractable models, among which the tree sparsity model, and illustrate selection and computation trade-offs between our framework and the existing convex relaxations.

📄 PDF Abstract BibTeX arXiv:1303.3207

Code (0)

등록된 구현이 없습니다.

Tasks

Compressive SensingmodelModel Selection

Similar Papers 제목 키워드 기반

Statistical Limits of Convex Relaxations

2015-03-04 · Zhaoran Wang, Quanquan Gu, Han Liu

Many high dimensional sparse learning problems are formulated as nonconvex optimization. A popular approach to solve these nonconvex optimization problems is through convex relaxations such as linear and semidefinite pro…

Sparse LearningStochastic Block Model

Grouped Variable Selection for Generalized Eigenvalue Problems

2021-05-28 · Jonathan Dan, Simon Geirnaert, Alexander Bertrand

Many problems require the selection of a subset of variables from a full set of optimization variables. The computational complexity of an exhaustive search over all possible subsets of variables is, however, prohibitive…

Variable Selection

On the exact recovery of sparse signals via conic relaxations

2016-03-15 · Hongbo Dong

In this note we compare two recently proposed semidefinite relaxations for the sparse linear regression problem by Pilanci, Wainwright and El Ghaoui (Sparse learning via boolean relaxations, 2015) and Dong, Chen and Lind…

Sparse LearningVariable Selection

Grouped Variable Selection with Discrete Optimization: Computational and Statistical Perspectives

2021-04-14 · Hussein Hazimeh, Rahul Mazumder, Peter Radchenko

We present a new algorithmic framework for grouped variable selection that is based on discrete mathematical optimization. While there exist several appealing approaches based on convex relaxations and nonconvex heuristi…

Sparse LearningVariable Selection

On Proper Learnability between Average- and Worst-case Robustness

2022-11-10 · NeurIPS 2023 11

Recently, Montasser et al. [2019] showed that finite VC dimension is not sufficient for proper adversarially robust PAC learning. In light of this hardness, there is a growing effort to study what type of relaxations to …

PAC learning