paper-with-me

Papers

Fast binary embeddings, and quantized compressed sensing with structured matrices

2018-01-26 · Thang Huynh, Rayan Saab

This paper deals with two related problems, namely distance-preserving binary embeddings and quantization for compressed sensing . First, we propose fast methods to replace points from a subset $\mathcal{X} \subset \mathbb{R}^n$, associated with the Euclidean metric, with points in the cube $\{\pm 1\}^m$ and we associate the cube with a pseudo-metric that approximates Euclidean distance among points in $\mathcal{X}$. Our methods rely on quantizing fast Johnson-Lindenstrauss embeddings based on bounded orthonormal systems and partial circulant ensembles, both of which admit fast transforms. Our quantization methods utilize noise-shaping, and include Sigma-Delta schemes and distributed noise-shaping schemes. The resulting approximation errors decay polynomially and exponentially fast in $m$, depending on the embedding method. This dramatically outperforms the current decay rates associated with binary embeddings and Hamming distances. Additionally, it is the first such binary embedding result that applies to fast Johnson-Lindenstrauss maps while preserving $\ell_2$ norms. Second, we again consider noise-shaping schemes, albeit this time to quantize compressed sensing measurements arising from bounded orthonormal ensembles and partial circulant matrices. We show that these methods yield a reconstruction error that again decays with the number of measurements (and bits), when using convex optimization for reconstruction. Specifically, for Sigma-Delta schemes, the error decays polynomially in the number of measurements, and it decays exponentially for distributed noise-shaping schemes based on beta encoding. These results are near optimal and the first of their kind dealing with bounded orthonormal systems.

📄 PDF Abstract BibTeX arXiv:1801.08639

Code (0)

등록된 구현이 없습니다.

Tasks

compressed sensingQuantization

Similar Papers 제목 키워드 기반

On the Acceleration of Deep Neural Network Inference using Quantized Compressed Sensing

2021-08-23 · Meshia Cédric Oveneke

Accelerating deep neural network (DNN) inference on resource-limited devices is one of the most important barriers to ensuring a wider and more inclusive adoption. To alleviate this, DNN binary quantization for faster co…

compressed sensingQuantization

Binary Iterative Hard Thresholding Converges with Optimal Number of Measurements for 1-Bit Compressed Sensing

2022-07-07 · Namiko Matsumoto, Arya Mazumdar

Compressed sensing has been a very successful high-dimensional signal acquisition and recovery technique that relies on linear operations. However, the actual measurements of signals have to be quantized before storing o…

compressed sensingLearning Theory

Efficient adaptation of complex-valued noiselet sensing matrices for compressed single-pixel imaging

2016-06-14 · Anna Pastuszczak, Bartłomiej Szczygieł, Michał Mikołajczyk, Rafał Kotyński

Minimal mutual coherence of discrete noiselets and Haar wavelets makes this pair of bases an essential choice for the measurement and compression matrices in compressed-sensing-based single-pixel detectors. In this paper…

compressed sensing

Quantizing Heavy-tailed Data in Statistical Estimation: (Near) Minimax Rates, Covariate Quantization, and Uniform Recovery

2022-12-30 · Junren Chen, Michael K. Ng, Di Wang

This paper studies the quantization of heavy-tailed data in some fundamental statistical estimation problems, where the underlying distributions have bounded moments of some order. We propose to truncate and properly dit…

compressed sensingMatrix CompletionQuantization

A Fast Method for Lasso and Logistic Lasso

2024-02-04 · Siu-Wing Cheng, Man Ting Wong

We propose a fast method for solving compressed sensing, Lasso regression, and Logistic Lasso regression problems that iteratively runs an appropriate solver using an active set approach. We design a strategy to update t…

compressed sensingregression