Error Feedback Approach for Quantization Noise Reduction of Distributed Graph Filters
This work introduces an error feedback approach for reducing quantization noise of distributed graph filters. It comes from error spectrum shaping techniques from state-space digital filters, and therefore establishes connections between quantized filtering processes over different domains. Quantization noise expression incorporating error feedback for finite impulse response (FIR) and autoregressive moving average (ARMA) graph filters are both derived with regard to time-invariant and time-varying graph topologies. Theoretical analysis is provided, and closed-form error weight coefficients are found. Numerical experiments demonstrate the effectiveness of the proposed method in noise reduction for the graph filters regardless of the deterministic and random graph topologies.
Code (0)
등록된 구현이 없습니다.
Tasks
QuantizationSimilar Papers 제목 키워드 기반
Quantitative Error Feedback for Quantization Noise Reduction of Filtering over Graphs
This paper introduces an innovative error feedback framework designed to mitigate quantization noise in distributed graph filtering, where communications are constrained to quantized messages. It comes from error spectru…
QuantizationQuantized Adam with Error Feedback
In this paper, we present a distributed variant of adaptive stochastic gradient method for training deep neural networks in the parameter-server model. To reduce the communication cost among the workers and server, we in…
QuantizationLinearly Converging Error Compensated SGD
In this paper, we propose a unified analysis of variants of distributed SGD with arbitrary compressions and delayed updates. Our framework is general enough to cover different variants of quantized SGD, Error-Compensated…
QuantizationCommunication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback
Communication overhead is a major bottleneck hampering the scalability of distributed machine learning systems. Recently, there has been a surge of interest in using gradient compression to improve the communication effi…
QuantizationSigma-Delta and Distributed Noise-Shaping Quantization Methods for Random Fourier Features
We propose the use of low bit-depth Sigma-Delta and distributed noise-shaping methods for quantizing the Random Fourier features (RFFs) associated with shift-invariant kernels. We prove that our quantized RFFs -- even in…
Quantization