paper-with-me

홈 › Papers

Practical Large-Scale Optimization for Max-norm Regularization

2010-12-01 · NeurIPS 2010 12 · Jason D. Lee, Ben Recht, Nathan Srebro, Joel Tropp, Ruslan R. Salakhutdinov

The max-norm was proposed as a convex matrix regularizer by Srebro et al (2004) and was shown to be empirically superior to the trace-norm for collaborative filtering problems. Although the max-norm can be computed in polynomial time, there are currently no practical algorithms for solving large-scale optimization problems that incorporate the max-norm. The present work uses a factorization technique of Burer and Monteiro (2003) to devise scalable first-order algorithms for convex programs involving the max-norm. These algorithms are applied to solve huge collaborative filtering, graph cut, and clustering problems. Empirically, the new methods outperform mature techniques from all three areas.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringCollaborative Filtering

Similar Papers 제목 키워드 기반

Comparison of Batch Normalization and Weight Normalization Algorithms for the Large-scale Image Classification

2017-09-24 · Igor Gitman, Boris Ginsburg

Batch normalization (BN) has become a de facto standard for training deep convolutional networks. However, BN accounts for a significant fraction of training run-time and is difficult to accelerate, since it is a memory-…

General Classificationimage-classificationImage Classification

Hybrid Conditional Gradient - Smoothing Algorithms with Applications to Sparse and Low Rank Regularization

2014-04-14 · Andreas Argyriou, Marco Signoretto, Johan Suykens

We study a hybrid conditional gradient - smoothing algorithm (HCGS) for solving composite convex optimization problems which contain several terms over a bounded set. Examples of these include regularization problems wit…

Robust Implicit Regularization via Weight Normalization

2023-05-09 · Hung-Hsu Chou, Holger Rauhut, Rachel Ward

Overparameterized models may have many interpolating solutions; implicit regularization refers to the hidden preference of a particular optimization method towards a certain interpolating solution among the many. A by no…

L2 Regularization versus Batch and Weight Normalization

2017-06-16 · Twan van Laarhoven

Batch Normalization is a commonly used trick to improve the training of deep neural networks. These neural networks use L2 regularization, also called weight decay, ostensibly to prevent overfitting. However, we show tha…

L2 Regularization

Framelet-Based Blind Image Restoration with Minimax Concave Regularization

2026-04-21 · Heng Zhang, Reza Parvaz, Rui Yang arxiv

Recovering corrupted images is one of the most challenging problems in image processing. Among various restoration tasks, blind image deblurring has been extensively studied due to its practical importance and inherent d…

Image RestorationImage Deblurring