paper-with-me

Papers

Robust 1-bit Compressed Sensing with Iterative Hard Thresholding

2023-10-12 · Namiko Matsumoto, Arya Mazumdar

In 1-bit compressed sensing, the aim is to estimate a $k$-sparse unit vector $x\in S^{n-1}$ within an $\epsilon$ error (in $\ell_2$) from minimal number of linear measurements that are quantized to just their signs, i.e., from measurements of the form $y = \mathrm{Sign}(\langle a, x\rangle).$ In this paper, we study a noisy version where a fraction of the measurements can be flipped, potentially by an adversary. In particular, we analyze the Binary Iterative Hard Thresholding (BIHT) algorithm, a proximal gradient descent on a properly defined loss function used for 1-bit compressed sensing, in this noisy setting. It is known from recent results that, with $\tilde{O}(\frac{k}{\epsilon})$ noiseless measurements, BIHT provides an estimate within $\epsilon$ error. This result is optimal and universal, meaning one set of measurements work for all sparse vectors. In this paper, we show that BIHT also provides better results than all known methods for the noisy setting. We show that when up to $\tau$-fraction of the sign measurements are incorrect (adversarial error), with the same number of measurements as before, BIHT agnostically provides an estimate of $x$ within an $\tilde{O}(\epsilon+\tau)$ error, maintaining the universality of measurements. This establishes stability of iterative hard thresholding in the presence of measurement error. To obtain the result, we use the restricted approximate invertibility of Gaussian matrices, as well as a tight analysis of the high-dimensional geometry of the adversarially corrupted measurements.

📄 PDF Abstract BibTeX arXiv:2310.08019

Code (0)

등록된 구현이 없습니다.

Tasks

compressed sensing

Similar Papers 제목 키워드 기반

Binary Iterative Hard Thresholding Converges with Optimal Number of Measurements for 1-Bit Compressed Sensing

2022-07-07 · Namiko Matsumoto, Arya Mazumdar

Compressed sensing has been a very successful high-dimensional signal acquisition and recovery technique that relies on linear operations. However, the actual measurements of signals have to be quantized before storing o…

compressed sensingLearning Theory

Normalized Iterative Hard Thresholding for Tensor Recovery

2025-07-06 · Li Li, Yuneng Liang, Kaijie Zheng, Jian Lu arxiv

Low-rank recovery builds upon ideas from the theory of compressive sensing, which predicts that sparse signals can be accurately reconstructed from incomplete measurements. Iterative thresholding-type algorithms-particul…

Compressive Sensing

Improved RIP-Based Bounds for Guaranteed Performance of two Compressed Sensing Algorithms

2020-07-03 · Yun-Bin Zhao, Zhi-Quan Luo

Iterative hard thresholding (IHT) and compressive sampling matching pursuit (CoSaMP) are two types of mainstream compressed sensing algorithms using hard thresholding operators for signal recovery and approximation. The …

4kcompressed sensing

Approximate Message Passing for Indoor THz Channel Estimation

2019-07-11

Compressed sensing (CS) deals with the problem of reconstructing a sparse vector from an under-determined set of observations. Approximate message passing (AMP) is a technique used in CS based on iterative thresholding a…

compressed sensing

Sparse Convex Optimization via Adaptively Regularized Hard Thresholding

2020-06-25 · ICML 2020 1 · Kyriakos Axiotis, Maxim Sviridenko

The goal of Sparse Convex Optimization is to optimize a convex function $f$ under a sparsity constraint $s\leq s^*\gamma$, where $s^*$ is the target number of non-zero entries in a feasible solution (sparsity) and $\gamm…

compressed sensing