paper-with-me

홈 › Papers

Better Approximation and Faster Algorithm Using the Proximal Average

2013-12-01 · NeurIPS 2013 12 · Yao-Liang Yu

It is a common practice to approximate complicated'' functions with more friendly ones. In large-scale machine learning applications, nonsmooth losses/regularizers that entail great computational challenges are usually approximated by smooth functions. We re-examine this powerful methodology and point out a nonsmooth approximation which simply pretends the linearity of the proximal map. The new approximation is justified using a recent convex analysis tool---proximal average, and yields a novel proximal gradient algorithm that is strictly better than the one based on smoothing, without incurring any extra overhead. Numerical experiments conducted on two important applications, overlapping group lasso and graph-guided fused lasso, corroborate the theoretical claims."

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Optimal Scaling for the Proximal Langevin Algorithm in High Dimensions

2022-04-21 · Natesh S. Pillai

The Metropolis-adjusted Langevin (MALA) algorithm is a sampling algorithm that incorporates the gradient of the logarithm of the target density in its proposal distribution. In an earlier joint work \citet{pill:stu:12}, …

Vocal Bursts Intensity Prediction

Proximal and Federated Random Reshuffling

2021-02-12 · NeurIPS 2021 12 · Konstantin Mishchenko, Ahmed Khaled, Peter Richtárik

Random Reshuffling (RR), also known as Stochastic Gradient Descent (SGD) without replacement, is a popular and theoretically grounded method for finite-sum minimization. We propose two new algorithms: Proximal and Federa…

NuSPAN: A Proximal Average Network for Nonuniform Sparse Model -- Application to Seismic Reflectivity Inversion

2021-05-01 · Swapnil Mache, Praveen Kumar Pokala, Kusala Rajendran, Chandra Sekhar Seelamantula

We solve the problem of sparse signal deconvolution in the context of seismic reflectivity inversion, which pertains to high-resolution recovery of the subsurface reflection coefficients. Our formulation employs a nonuni…

Decentralized Proximal Stochastic Gradient Langevin Dynamics

2026-05-01 · Mohammad Rafiqul Islam, Lingjiong Zhu arxiv

We propose Decentralized Proximal Stochastic Gradient Langevin Dynamics (DE-PSGLD), a decentralized Markov chain Monte Carlo (MCMC) algorithm for sampling from a log-concave probability distribution constrained to a conv…

Faster proximal algorithms for matrix optimization using Jacobi-based eigenvalue methods

2021-12-01 · NeurIPS 2021 12 · Hamza Fawzi, Harry Goulbourne

We consider proximal splitting algorithms for convex optimization problems over matrices. A significant computational bottleneck in many of these algorithms is the need to compute a full eigenvalue or singular value deco…

CPUGPU