paper-with-me

Papers

Auto-encoders for compressed sensing

2019-09-14 · NeurIPS Workshop Deep_Invers 2019 12 · Pei Peng, Shirin Jalali, Xin Yuan

Compressed sensing is about recovering a structured high-dimensional signal ${\bf x}\in R^n$ from its under-determined noisy linear measurements ${\bf y}\in R^m$, where $m\ll n$. While the vast majority of the literature in this area is on sparse signals, in recent years, there has been considerable progress on compressed sensing of signals with structures beyond sparsity. One of the promising approaches in this field is to employ generative models that are based on trained neural networks. In this paper, we study the performance of an iterative algorithm based on projected gradient descent that employs an auto-encoder to define and enforce the source structure. The auto-encoder is defined by a generative function $g:R^k\rightarrow R^n$ and a separate neural network that is trained to function as the inverse of $g$. We prove that, for a generative model $g$ with $\ell_2$ representation error $\delta$, given roughly $m>40k\log{1\over \delta}$ measurements, such an algorithm converges, even in the presence of additive white Gaussian noise.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

compressed sensing

Similar Papers 제목 키워드 기반

Uncertainty Autoencoders: Learning Compressed Representations via Variational Information Maximization

2018-12-26 · Aditya Grover, Stefano Ermon

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework fo…

compressed sensingDimensionality ReductionRepresentation Learning

Cascade Decoders-Based Autoencoders for Image Reconstruction

2021-06-29 · Honggui Li, Dimitri Galayko, Maria Trocan, Mohamad Sawan

Autoencoders are composed of coding and decoding units, hence they hold the inherent potential of high-performance data compression and signal compressed sensing. The main disadvantages of current autoencoders comprise t…

compressed sensingData CompressionImage CompressionImage Reconstruction

Learned Compression for Compressed Learning

2024-12-12 · Dan Jacobellis, Neeraja J. Yadwadkar

Modern sensors produce increasingly rich streams of high-resolution data. Due to resource constraints, machine learning systems discard the vast majority of this information via resolution reduction. Compressed-domain le…

Colorizationdocument understandingimage-classificationImage Classification+1

Compute Optimal Inference and Provable Amortisation Gap in Sparse Autoencoders

2024-11-20 · Charles O'Neill, Alim Gumran, David Klindt

A recent line of work has shown promise in using sparse autoencoders (SAEs) to uncover interpretable features in neural network representations. However, the simple linear-nonlinear encoding mechanism in SAEs limits thei…

compressed sensingLanguage ModelingLanguage ModellingLarge Language Model

On Optimality Conditions for Auto-Encoder Signal Recovery

2016-05-23 · ICLR 2018 1 · Devansh Arpit, Yingbo Zhou, Hung Q. Ngo, Nils Napp 외

Auto-Encoders are unsupervised models that aim to learn patterns from observed data by minimizing a reconstruction cost. The useful representations learned are often found to be sparse and distributed. On the other hand,…

compressed sensing