paper-with-me

홈 › Papers

Noise-Aware Differentially Private Variational Inference

2024-10-25 · Talal Alrawajfeh, Joonas Jälkö, Antti Honkela

Differential privacy (DP) provides robust privacy guarantees for statistical inference, but this can lead to unreliable results and biases in downstream applications. While several noise-aware approaches have been proposed which integrate DP perturbation into the inference, they are limited to specific types of simple probabilistic models. In this work, we propose a novel method for noise-aware approximate Bayesian inference based on stochastic gradient variational inference which can also be applied to high-dimensional and non-conjugate models. We also propose a more accurate evaluation method for noise-aware posteriors. Empirically, our inference method has similar performance to existing methods in the domain where they are applicable. Outside this domain, we obtain accurate coverages on high-dimensional Bayesian linear regression and well-calibrated predictive probabilities on Bayesian logistic regression with the UCI Adult dataset.

📄 PDF Abstract BibTeX arXiv:2410.19371

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferenceregressionVariational Inference

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…
Variational Inference 설명 없음
Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

DP-IVON-Gradsq: Differentially Private Squared-Gradient Improved Variational Online Newton

2026-07-26 · Nour Jamoussi, Ikram Dridi, Giuseppe Serra, Marios Kountouris arxiv

Differential privacy provides formal privacy guarantees for training neural networks on sensitive data, while Bayesian deep learning offers a principled framework for uncertainty-aware prediction. Combining these two obj…

Computational Efficiency

DPVIm: Differentially Private Variational Inference Improved

2022-10-28 · Joonas Jälkö, Lukas Prediger, Antti Honkela, Samuel Kaski

Differentially private (DP) release of multidimensional statistics typically considers an aggregate sensitivity, e.g. the vector norm of a high-dimensional vector. However, different dimensions of that vector might have …

Variational Inference

An end-to-end Differentially Private Latent Dirichlet Allocation Using a Spectral Algorithm

2018-05-25 · ICML 2020 1 · Christopher DeCarolis, Mukul Ram, Seyed A. Esmaeili, Yu-Xiang Wang 외

We provide an end-to-end differentially private spectral algorithm for learning LDA, based on matrix/tensor decompositions, and establish theoretical guarantees on utility/consistency of the estimated model parameters. T…

SensitivityVariational Inference

Differentially Private Variational Inference for Non-conjugate Models

2016-10-27 · Joonas Jälkö, Onur Dikmen, Antti Honkela

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has …

Bayesian InferenceVariational Inference

Private Posterior distributions from Variational approximations

2015-11-24 · Vishesh Karwa, Dan Kifer, Aleksandra B. Slavković

Privacy preserving mechanisms such as differential privacy inject additional randomness in the form of noise in the data, beyond the sampling mechanism. Ignoring this additional noise can lead to inaccurate and invalid i…

Privacy Preservingvalid