paper-with-me

Papers

Recovering Simultaneously Structured Data via Non-Convex Iteratively Reweighted Least Squares

2023-06-08 · NeurIPS 2023 11 · Christian Kümmerle, Johannes Maly

We propose a new algorithm for the problem of recovering data that adheres to multiple, heterogeneous low-dimensional structures from linear observations. Focusing on data matrices that are simultaneously row-sparse and low-rank, we propose and analyze an iteratively reweighted least squares (IRLS) algorithm that is able to leverage both structures. In particular, it optimizes a combination of non-convex surrogates for row-sparsity and rank, a balancing of which is built into the algorithm. We prove locally quadratic convergence of the iterates to a simultaneously structured data matrix in a regime of minimal sample complexity (up to constants and a logarithmic factor), which is known to be impossible for a combination of convex surrogates. In experiments, we show that the IRLS method exhibits favorable empirical convergence, identifying simultaneously row-sparse and low-rank matrices from fewer measurements than state-of-the-art methods. Code is available at https://github.com/ckuemmerle/simirls.

📄 PDF Abstract BibTeX arXiv:2306.04961

Code (1)

ckuemmerle/simirls 공식 구현

Similar Papers 제목 키워드 기반

Precise Phase Transition of Total Variation Minimization

2015-09-15 · Bingwen Zhang, Weiyu Xu, Jian-Feng Cai, Lifeng Lai

Characterizing the phase transitions of convex optimizations in recovering structured signals or data is of central importance in compressed sensing, machine learning and statistics. The phase transitions of many convex …

compressed sensingDenoising

Proximal Iteratively Reweighted Algorithm with Multiple Splitting for Nonconvex Sparsity Optimization

2014-04-28 · Canyi Lu, Yunchao Wei, Zhouchen Lin, Shuicheng Yan

This paper proposes the Proximal Iteratively REweighted (PIRE) algorithm for solving a general problem, which involves a large body of nonconvex sparse and structured sparse related problems. Comparing with previous iter…

Convexification of Neural Graph

2018-01-09 · Han Xiao

Traditionally, most complex intelligence architectures are extremely non-convex, which could not be well performed by convex optimization. However, this paper decomposes complex structures into three types of nodes: oper…

A Nonconvex Approach for Structured Sparse Learning

2015-03-07 · Shubao Zhang, Hui Qian, Zhihua Zhang

Sparse learning is an important topic in many areas such as machine learning, statistical estimation, signal processing, etc. Recently, there emerges a growing interest on structured sparse learning. In this paper we foc…

Sparse Learning

Near-Optimal Nonconvex Matrix Completion

2026-09-15 · Jian-Feng Cai, Xiliang Lu, Juntao You arxiv

We study nonconvex methods for matrix completion, the problem of recovering a low-rank matrix from a subset of its entries. Convex methods achieve sample complexity linear in the matrix dimension and the rank, up to loga…