paper-with-me

Papers

An Asynchronous Parallel Approach to Sparse Recovery

2017-01-12 · Deanna Needell, Tina Woolf

Asynchronous parallel computing and sparse recovery are two areas that have received recent interest. Asynchronous algorithms are often studied to solve optimization problems where the cost function takes the form $\sum_{i=1}^M f_i(x)$, with a common assumption that each $f_i$ is sparse; that is, each $f_i$ acts only on a small number of components of $x\in\mathbb{R}^n$. Sparse recovery problems, such as compressed sensing, can be formulated as optimization problems, however, the cost functions $f_i$ are dense with respect to the components of $x$, and instead the signal $x$ is assumed to be sparse, meaning that it has only $s$ non-zeros where $s\ll n$. Here we address how one may use an asynchronous parallel architecture when the cost functions $f_i$ are not sparse in $x$, but rather the signal $x$ is sparse. We propose an asynchronous parallel approach to sparse recovery via a stochastic greedy algorithm, where multiple processors asynchronously update a vector in shared memory containing information on the estimated signal support. We include numerical simulations that illustrate the potential benefits of our proposed asynchronous method.

📄 PDF Abstract BibTeX arXiv:1701.03458

Code (0)

등록된 구현이 없습니다.

Tasks

compressed sensing

Similar Papers 제목 키워드 기반

AsyncMesh: Fully Asynchronous Optimization for Data and Pipeline Parallelism

2026-01-30 · Thalaiyasingam Ajanthan, Sameera Ramasinghe, Gil Avraham, Hadi Mohaghegh Dolatabadi 외 arxiv

Data and pipeline parallelism are key strategies for scaling neural network training across distributed devices, but their high communication cost necessitates co-located computing clusters with fast interconnects, limit…

Async-RED: A Provably Convergent Asynchronous Block Parallel Stochastic Method using Deep Denoising Priors

2020-10-03 · ICLR 2021 1 · Yu Sun, Jiaming Liu, Yiran Sun, Brendt Wohlberg 외

Regularization by denoising (RED) is a recently developed framework for solving inverse problems by integrating advanced denoisers as image priors. Recent work has shown its state-of-the-art performance when combined wit…

Denoising

Asynchronous Parallel Learning for Neural Networks and Structured Models with Dense Features

2016-12-01 · COLING 2016 12 · Xu Sun

Existing asynchronous parallel learning methods are only for the sparse feature models, and they face new challenges for the dense feature models like neural networks (e.g., LSTM, RNN). The problem for dense features is …

Low-Rank Matrix CompletionMatrix Completion

Asynchronous Random Access in Massive MIMO Systems Facilitated by the Delay-Angle Domain

2024-12-06 · Ao Chen, Wei Chen, Bo Ai, Petar Popovski

The problem of uplink transmissions in massive connectivity is commonly dealt with using schemes for grant-free random access. When a large number of devices transmit almost synchronously, the receiver may not be able to…

Action DetectionActivity Detection

Perturbed Iterate Analysis for Asynchronous Stochastic Optimization

2015-07-24 · Horia Mania, Xinghao Pan, Dimitris Papailiopoulos, Benjamin Recht 외

We introduce and analyze stochastic optimization methods where the input to each gradient update is perturbed by bounded noise. We show that this framework forms the basis of a unified approach to analyze asynchronous im…

Stochastic Optimization