paper-with-me

Papers

Variational Inference with Latent Space Quantization for Adversarial Resilience

2019-03-24 · Vinay Kyatham, Mayank Mishra, Tarun Kumar Yadav, Deepak Mishra, Prathosh AP

Despite their tremendous success in modelling high-dimensional data manifolds, deep neural networks suffer from the threat of adversarial attacks - Existence of perceptually valid input-like samples obtained through careful perturbation that lead to degradation in the performance of the underlying model. Major concerns with existing defense mechanisms include non-generalizability across different attacks, models and large inference time. In this paper, we propose a generalized defense mechanism capitalizing on the expressive power of regularized latent space based generative models. We design an adversarial filter, devoid of access to classifier and adversaries, which makes it usable in tandem with any classifier. The basic idea is to learn a Lipschitz constrained mapping from the data manifold, incorporating adversarial perturbations, to a quantized latent space and re-map it to the true data manifold. Specifically, we simultaneously auto-encode the data manifold and its perturbations implicitly through the perturbations of the regularized and quantized generative latent space, realized using variational inference. We demonstrate the efficacy of the proposed formulation in providing resilience against multiple attack types (black and white box) and methods, while being almost real-time. Our experiments show that the proposed method surpasses the state-of-the-art techniques in several cases.

📄 PDF Abstract BibTeX arXiv:1903.09940

Code (1)

mayank31398/lqvae 공식 구현 tf

Tasks

QuantizationvalidVariational Inference

Similar Papers 제목 키워드 기반

Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriors

2024-01-05 · Wasu Top Piriyakulkij, Yingheng Wang, Volodymyr Kuleshov

We propose denoising diffusion variational inference (DDVI), a black-box variational inference algorithm for latent variable models which relies on diffusion models as flexible approximate posteriors. Specifically, our m…

DenoisingVariational Inference

LASERS: LAtent Space Encoding for Representations with Sparsity for Generative Modeling

2024-09-16 · Xin Li, Anand Sarwate

Learning compact and meaningful latent space representations has been shown to be very useful in generative modeling tasks for visual data. One particular example is applying Vector Quantization (VQ) in variational autoe…

Dictionary LearningQuantization

VAEVQ: Enhancing Discrete Visual Tokenization through Variational Modeling

2025-11-10 · Sicheng Yang, Xing Hu, Qiang Wu, Dawei Yang arxiv

Vector quantization (VQ) transforms continuous image features into discrete representations, providing compressed, tokenized inputs for generative models. However, VQ-based frameworks suffer from several issues, such as …

Function-Space Variational Inference for Deep Bayesian Classification

2021-09-29 · Jihao Andreas Lin, Joe Watson, Pascal Klink, Jan Peters

Bayesian deep learning approaches assume model parameters to be latent random variables and infer posterior predictive distributions to quantify uncertainty, increase safety and trust, and prevent overconfident and unpre…

Adversarial RobustnessClassificationimage-classificationImage Classification+2

Continuous Autoregressive Modeling with Stochastic Monotonic Alignment for Speech Synthesis

2025-02-03 · Weiwei Lin, Chenghan He

We propose a novel autoregressive modeling approach for speech synthesis, combining a variational autoencoder (VAE) with a multi-modal latent space and an autoregressive model that uses Gaussian Mixture Models (GMM) as t…

QuantizationSpeech Synthesis