b-bit Marginal Regression
We consider the problem of sparse signal recovery from $m$ linear measurements quantized to $b$ bits. $b$-bit Marginal Regression is proposed as recovery algorithm. We study the question of choosing $b$ in the setting of a given budget of bits $B = m \cdot b$ and derive a single easy-to-compute expression characterizing the trade-off between $m$ and $b$. The choice $b = 1$ turns out to be optimal for estimating the unit vector corresponding to the signal for any level of additive Gaussian noise before quantization as well as for adversarial noise. For $b \geq 2$, we show that Lloyd-Max quantization constitutes an optimal quantization scheme and that the norm of the signal canbe estimated consistently by maximum likelihood.
Code (0)
등록된 구현이 없습니다.
Tasks
QuantizationregressionSimilar Papers 제목 키워드 기반
Advanced Models for Hourly Marginal CO2 Emission Factor Estimation: A Synergy between Fundamental and Statistical Approaches
Global warming is caused by increasing concentrations of greenhouse gases, particularly carbon dioxide (CO2). A metric used to quantify the change in CO2 emissions is the marginal emission factor, defined as the marginal…
regressionExact Post Model Selection Inference for Marginal Screening
We develop a framework for post model selection inference, via marginal screening, in linear regression. At the core of this framework is a result that characterizes the exact distribution of linear functions of the resp…
Model SelectionregressionTwo-sample testingvalidMarginally-calibrated deep distributional regression
Deep neural network (DNN) regression models are widely used in applications requiring state-of-the-art predictive accuracy. However, until recently there has been little work on accurate uncertainty quantification for pr…
regressionTime Series AnalysisUncertainty QuantificationBitcoin price and its marginal cost of production: support for a fundamental value
This study back-tests a marginal cost of production model proposed to value the digital currency bitcoin. Results from both conventional regression and vector autoregression (VAR) models show that the marginal cost of pr…
regressionMELCOT: A Hybrid Learning Architecture with Marginal Preservation for Matrix-Valued Regression
Regression is essential across many domains but remains challenging in high-dimensional settings, where existing methods often lose spatial structure or demand heavy storage. In this work, we address the problem of matri…