paper-with-me

홈 › Papers

Efficient Consensus Model based on Proximal Gradient Method applied to Convolutional Sparse Problems

2020-11-19 · Gustavo Silva, Paul Rodriguez

Convolutional sparse representation (CSR), shift-invariant model for inverse problems, has gained much attention in the fields of signal/image processing, machine learning and computer vision. The most challenging problems in CSR implies the minimization of a composite function of the form $min_x \sum_i f_i(x) + g(x)$, where a direct and low-cost solution can be difficult to achieve. However, it has been reported that semi-distributed formulations such as ADMM consensus can provide important computational benefits. In the present work, we derive and detail a thorough theoretical analysis of an efficient consensus algorithm based on proximal gradient (PG) approach. The effectiveness of the proposed algorithm with respect to its ADMM counterpart is primarily assessed in the classic convolutional dictionary learning problem. Furthermore, our consensus method, which is generically structured, can be used to solve other optimization problems, where a sum of convex functions with a regularization term share a single global variable. As an example, the proposed algorithm is also applied to another particular convolutional problem for the anomaly detection task.

📄 PDF Abstract BibTeX arXiv:2011.10100

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionDictionary Learning

Methods 이 논문이 사용한 방법론

ADMM The alternating direction method of multipliers (ADMM) is an algorithm that solves convex optimization problems by breaking them into smaller pieces, each of which are…

Similar Papers 제목 키워드 기반

A Proximal Algorithm for Network Slimming

2023-07-02 · Kevin Bui, Fanghui Xue, Fredrick Park, Yingyong Qi 외

As a popular channel pruning method for convolutional neural networks (CNNs), network slimming (NS) has a three-stage process: (1) it trains a CNN with $\ell_1$ regularization applied to the scaling factors of the batch …

Improved sparse PCA method for face and image recognition

2021-12-01 · Loc Hoang Tran, Tuan Tran, An Mai

Face recognition is the very significant field in pattern recognition area. It has multiple applications in military and finance, to name a few. In this paper, the combination of the sparse PCA with the nearest-neighbor …

ClassificationFace Recognition

Distributed Sparse Regression via Penalization

2021-11-12 · Yao Ji, Gesualdo Scutari, Ying Sun, Harsha Honnappa

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions…

regression

RAPID: Rapidly Accelerated Proximal Gradient Algorithms for Convex Minimization

2014-06-13 · Ziming Zhang, Venkatesh Saligrama

In this paper, we propose a new algorithm to speed-up the convergence of accelerated proximal gradient (APG) methods. In order to minimize a convex function $f(\mathbf{x})$, our algorithm introduces a simple line search …

Online Learning over Dynamic Graphs via Distributed Proximal Gradient Algorithm

2019-05-16 · Rishabh Dixit, Amrit Singh Bedi, Ketan Rajawat

We consider the problem of tracking the minimum of a time-varying convex optimization problem over a dynamic graph. Motivated by target tracking and parameter estimation problems in intermittently connected robotic and s…

parameter estimation