paper-with-me

홈 › Papers

Efficient Proximal Mapping Computation for Unitarily Invariant Low-Rank Inducing Norms

2018-10-17 · Christian Grussler, Pontus Giselsson

Low-rank inducing unitarily invariant norms have been introduced to convexify problems with low-rank/sparsity constraint. They are the convex envelope of a unitary invariant norm and the indicator function of an upper bounding rank constraint. The most well-known member of this family is the so-called nuclear norm. To solve optimization problems involving such norms with proximal splitting methods, efficient ways of evaluating the proximal mapping of the low-rank inducing norms are needed. This is known for the nuclear norm, but not for most other members of the low-rank inducing family. This work supplies a framework that reduces the proximal mapping evaluation into a nested binary search, in which each iteration requires the solution of a much simpler problem. This simpler problem can often be solved analytically as it is demonstrated for the so-called low-rank inducing Frobenius and spectral norms. Moreover, the framework allows to compute the proximal mapping of compositions of these norms with increasing convex functions and the projections onto their epigraphs. This has the additional advantage that we can also deal with compositions of increasing convex functions and low-rank inducing norms in proximal splitting methods.

📄 PDF Abstract BibTeX arXiv:1810.07570

Code (2)

LowRankOpt/LRINorm 공식 구현
LowRankOpt/LRIPy 공식 구현

Similar Papers 제목 키워드 기반

The Singular Value Decomposition, Applications and Beyond

2015-10-29 · Zhihua Zhang

The singular value decomposition (SVD) is not only a classical theory in matrix computation and analysis, but also is a powerful tool in machine learning and modern data analysis. In this tutorial we first study the basi…

BIG-bench Machine LearningMatrix Completion

Intrinsic Muon: Spectral Optimization on Riemannian Matrix Manifolds

2026-05-10 · Yibang Li, Bihari Lal Pandey, Ravi Sah, Andi Han 외 arxiv

Muon and related norm-constrained matrix optimizers have become central to large-scale learning problems. They are formulated as a linear maximization oracle (LMO) over an ambient matrix-norm ball in unconstrained Euclid…

Image Classification

Capacity Optimality of OAMP in Coded Large Unitarily Invariant Systems

2022-06-23 · Lei Liu, Shansuo Liang, Li Ping

This paper investigates a large unitarily invariant system (LUIS) involving a unitarily invariant sensing matrix, an arbitrary fixed signal distribution, and forward error control (FEC) coding. Several area properties ar…

Norm-Bounded Low-Rank Adaptation

2025-01-31 · Ruigang Wang, Krishnamurthy Dvijotham, Ian R. Manchester

In this work, we propose norm-bounded low-rank adaptation (NB-LoRA) for parameter-efficient fine tuning. We introduce two parameterizations that allow explicit bounds on each singular value of the weight adaptation matri…

Low-Rank Matrix CompletionMatrix Completionparameter-efficient fine-tuningPrivacy Preserving

Analysis of singular subspaces under random perturbations

2024-03-14 · Ke Wang

We present a comprehensive analysis of singular vector and singular subspace perturbations in the context of the signal plus random Gaussian noise matrix model. Assuming a low-rank signal matrix, we extend the Davis-Kaha…