paper-with-me

Papers

SPRIGHT: A Fast and Robust Framework for Sparse Walsh-Hadamard Transform

2015-08-26 · Xiao Li, Joseph K. Bradley, Sameer Pawar, Kannan Ramchandran

We consider the problem of computing the Walsh-Hadamard Transform (WHT) of some $N$-length input vector in the presence of noise, where the $N$-point Walsh spectrum is $K$-sparse with $K = {O}(N^{\delta})$ scaling sub-linearly in the input dimension $N$ for some $0<\delta<1$. Over the past decade, there has been a resurgence in research related to the computation of Discrete Fourier Transform (DFT) for some length-$N$ input signal that has a $K$-sparse Fourier spectrum. In particular, through a sparse-graph code design, our earlier work on the Fast Fourier Aliasing-based Sparse Transform (FFAST) algorithm computes the $K$-sparse DFT in time ${O}(K\log K)$ by taking ${O}(K)$ noiseless samples. Inspired by the coding-theoretic design framework, Scheibler et al. proposed the Sparse Fast Hadamard Transform (SparseFHT) algorithm that elegantly computes the $K$-sparse WHT in the absence of noise using ${O}(K\log N)$ samples in time ${O}(K\log^2 N)$. However, the SparseFHT algorithm explicitly exploits the noiseless nature of the problem, and is not equipped to deal with scenarios where the observations are corrupted by noise. Therefore, a question of critical interest is whether this coding-theoretic framework can be made robust to noise. Further, if the answer is yes, what is the extra price that needs to be paid for being robust to noise? In this paper, we show, quite interestingly, that there is {\it no extra price} that needs to be paid for being robust to noise other than a constant factor. In other words, we can maintain the same sample complexity ${O}(K\log N)$ and the computational complexity ${O}(K\log^2 N)$ as those of the noiseless case, using our SParse Robust Iterative Graph-based Hadamard Transform (SPRIGHT) algorithm.

📄 PDF Abstract BibTeX arXiv:1508.06336

Code (3)

aditya-sengupta/SparseTransforms.jl
aditya-sengupta/spright
amirmohan/epistatic-net pytorch

Similar Papers 제목 키워드 기반

Fast Walsh-Hadamard Transform and Smooth-Thresholding Based Binary Layers in Deep Neural Networks

2021-04-14 · Hongyi Pan, Diaa Dabawi, Ahmet Enis Cetin

In this paper, we propose a novel layer based on fast Walsh-Hadamard transform (WHT) and smooth-thresholding to replace $1\times 1$ convolution layers in deep neural networks. In the WHT domain, we denoise the transform …

McKernel: A Library for Approximate Kernel Expansions in Log-linear Time

2017-02-27 · Joachim D. Curtó, Irene C. Zarza, Feng Yang, Alexander J. Smola 외

Kernel Methods Next Generation (KMNG) introduces a framework to use kernel approximates in the mini-batch setting with SGD Optimizer as an alternative to Deep Learning. McKernel is a C++ library for KMNG ML Large-scale. …

CPUGeneral Classification

Efficient Approximate Inference with Walsh-Hadamard Variational Inference

2019-11-29 · Simone Rossi, Sebastien Marmin, Maurizio Filippone

Variational inference offers scalable and flexible tools to tackle intractable Bayesian inference of modern statistical models like Bayesian neural networks and Gaussian processes. For largely over-parameterized models, …

Bayesian InferenceGaussian ProcessesVariational Inference

Structured Linear CDEs: Maximally Expressive and Parallel-in-Time Sequence Models

2025-05-23 · Benjamin Walker, Lingyi Yang, Nicola Muca Cirone, Cristopher Salvi 외

Structured Linear Controlled Differential Equations (SLiCEs) provide a unifying framework for sequence models with structured, input-dependent state-transition matrices that retain the maximal expressivity of dense matri…

MambaTime Series Classification

Nearly Optimal Deterministic Algorithm for Sparse Walsh-Hadamard Transform

2015-04-28 · Mahdi Cheraghchi, Piotr Indyk

For every fixed constant $\alpha > 0$, we design an algorithm for computing the $k$-sparse Walsh-Hadamard transform of an $N$-dimensional vector $x \in \mathbb{R}^N$ in time $k^{1+\alpha} (\log N)^{O(1)}$. Specifically, …

compressed sensing