paper-with-me

Papers

Accelerated Training for Matrix-norm Regularization: A Boosting Approach

2012-12-01 · NeurIPS 2012 12 · Xinhua Zhang, Dale Schuurmans, Yao-Liang Yu

Sparse learning models typically combine a smooth loss with a nonsmooth penalty, such as trace norm. Although recent developments in sparse approximation have offered promising solution methods, current approaches either apply only to matrix-norm constrained problems or provide suboptimal convergence rates. In this paper, we propose a boosting method for regularized learning that guarantees $\epsilon$ accuracy within $O(1/\epsilon)$ iterations. Performance is further accelerated by interlacing boosting with fixed-rank local optimization---exploiting a simpler local objective than previous work. The proposed method yields state-of-the-art performance on large-scale problems. We also demonstrate an application to latent multiview learning for which we provide the first efficient weak-oracle.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Multiview LearningSparse Learning

Similar Papers 제목 키워드 기반

Preconditioning for Accelerated Gradient Descent Optimization and Regularization

2024-09-30 · Qiang Ye

Accelerated training algorithms, such as adaptive learning rates and various normalization methods, are widely used but not fully understood. When regularization is introduced, standard optimizers like adaptive learning …

Accelerated structured matrix factorization

2022-12-13 · Lorenzo Schiavon, Bernardo Nipoti, Antonio Canale

Matrix factorization exploits the idea that, in complex high-dimensional data, the actual signal typically lies in lower-dimensional structures. These lower dimensional objects provide useful insight, with interpretabili…

Hyperspectral Image Recovery via Hybrid Regularization

2015-11-09 · Reza Arablouei, Frank de Hoog

Natural images tend to mostly consist of smooth regions with individual pixels having highly correlated spectra. This information can be exploited to recover hyperspectral images of natural scenes from their incomplete a…

Denoising

Truncated nuclear norm regularization for low-rank tensor completion

2019-01-07 · Shengke Xue, Wenyuan Qiu, Fan Liu, Xinyu Jin

Recently, low-rank tensor completion has become increasingly attractive in recovering incomplete visual data. Considering a color image or video as a three-dimensional (3D) tensor, existing studies have put forward sever…

Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion

2024-05-22 · Zhiwei Bai, Jiajie Zhao, Yaoyu Zhang

Matrix factorization models have been extensively studied as a valuable test-bed for understanding the implicit biases of overparameterized models. Although both low nuclear norm and low rank regularization have been stu…

Matrix Completion