paper-with-me

Papers

Learning Sparse Graph with Minimax Concave Penalty under Gaussian Markov Random Fields

2021-09-17 · Tatsuya Koyakumaru, Masahiro Yukawa, Eduardo Pavez, Antonio Ortega

This paper presents a convex-analytic framework to learn sparse graphs from data. While our problem formulation is inspired by an extension of the graphical lasso using the so-called combinatorial graph Laplacian framework, a key difference is the use of a nonconvex alternative to the $\ell_1$ norm to attain graphs with better interpretability. Specifically, we use the weakly-convex minimax concave penalty (the difference between the $\ell_1$ norm and the Huber function) which is known to yield sparse solutions with lower estimation bias than $\ell_1$ for regression problems. In our framework, the graph Laplacian is replaced in the optimization by a linear transform of the vector corresponding to its upper triangular part. Via a reformulation relying on Moreau's decomposition, we show that overall convexity is guaranteed by introducing a quadratic function to our cost function. The problem can be solved efficiently by the primal-dual splitting method, of which the admissible conditions for provable convergence are presented. Numerical examples show that the proposed method significantly outperforms the existing graph learning methods with reasonable CPU time.

📄 PDF Abstract BibTeX arXiv:2109.08666

Code (0)

등록된 구현이 없습니다.

Tasks

CPUGraph Learning

Similar Papers 제목 키워드 기반

Nonconvex Latent Optimally Partitioned Block-Sparse Recovery via Log-Sum and Minimax Concave Penalties

2026-03-01 · Takanobu Furuhashi, Hiroki Kuroda, Masahiro Yukawa, Qibin Zhao 외 arxiv

We propose two nonconvex regularization methods, LogLOP-l2/l1 and AdaLOP-l2/l1, for recovering block-sparse signals with unknown block partitions. These methods address the underestimation bias of existing convex approac…

Minimax Concave Penalty Regularized Adaptive System Identification

2022-11-07 · Bowen Li, Suya Wu, Erin E. Tripp, Ali Pezeshki 외

We develop a recursive least square (RLS) type algorithm with a minimax concave penalty (MCP) for adaptive identification of a sparse tap-weight vector that represents a communication channel. The proposed algorithm recu…

Time SeriesTime Series Analysis

Efficient Graph Laplacian Estimation by Proximal Newton

2023-02-13 · Yakov Medvedovsky, Eran Treister, Tirza Routtenberg

The Laplacian-constrained Gaussian Markov Random Field (LGMRF) is a common multivariate statistical model for learning a weighted sparse dependency graph from given data. This graph learning problem can be formulated as …

Graph Learning

Low-rank tensor completion via a novel minimax $p$-th order concave penalty function

2025-02-27 · HongBing Zhang

Low-rank tensor completion (LRTC) has attracted significant attention in fields such as computer vision and pattern recognition. Among the various techniques employed in LRTC, non-convex relaxation methods have been wide…

Linearly-involved Moreau-Enhanced-over-Subspace Model: Debiased Sparse Modeling and Stable Outlier-Robust Regression

2022-01-10 · Masahiro Yukawa, Hiroyuki Kaneko, Kyohei Suzuki, Isao Yamada

We present an efficient mathematical framework based on the linearly-involved Moreau-enhanced-over-subspace (LiMES) model. Two concrete applications are considered: sparse modeling and robust regression. The popular mini…

regressionRobust classification