paper-with-me

Papers

Gaussian-Smoothed Sliced Probability Divergences

2024-04-04 · Mokhtar Z. Alaya, Alain Rakotomamonjy, Maxime Berar, Gilles Gasso

Gaussian smoothed sliced Wasserstein distance has been recently introduced for comparing probability distributions, while preserving privacy on the data. It has been shown that it provides performances similar to its non-smoothed (non-private) counterpart. However, the computationaland statistical properties of such a metric have not yet been well-established. This work investigates the theoretical properties of this distance as well as those of generalized versions denoted as Gaussian-smoothed sliced divergences. We first show that smoothing and slicing preserve the metric property and the weak topology. To study the sample complexity of such divergences, we then introduce $\hat{\hat\mu}_{n}$ the double empirical distribution for the smoothed-projected $\mu$. The distribution $\hat{\hat\mu}_{n}$ is a result of a double sampling process: one from sampling according to the origin distribution $\mu$ and the second according to the convolution of the projection of $\mu$ on the unit sphere and the Gaussian smoothing. We particularly focus on the Gaussian smoothed sliced Wasserstein distance and prove that it converges with a rate $O(n^{-1/2})$. We also derive other properties, including continuity, of different divergences with respect to the smoothing parameter. We support our theoretical findings with empirical studies in the context of privacy-preserving domain adaptation.

📄 PDF Abstract BibTeX arXiv:2404.03273

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationPrivacy Preserving

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Statistical and Topological Properties of Gaussian Smoothed Sliced Probability Divergences

2021-10-20 · Alain Rakotomamonjy, Mokhtar Z. Alaya, Maxime Berar, Gilles Gasso

Gaussian smoothed sliced Wasserstein distance has been recently introduced for comparing probability distributions, while preserving privacy on the data. It has been shown, in applications such as domain adaptation, to p…

Domain AdaptationPrivacy Preserving

Differentially Private Sliced Wasserstein Distance

2021-07-05 · Alain Rakotomamonjy, Liva Ralaivola

Developing machine learning methods that are privacy preserving is today a central topic of research, with huge practical impacts. Among the numerous ways to address privacy-preserving learning, we here take the perspect…

Domain AdaptationPrivacy Preserving

Statistical and Topological Properties of Sliced Probability Divergences

2020-03-12 · NeurIPS 2020 12 · Kimia Nadjahi, Alain Durmus, Lénaïc Chizat, Soheil Kolouri 외

The idea of slicing divergences has been proven to be successful when comparing two probability measures in various machine learning applications including generative modeling, and consists in computing the expected valu…

Differentially Private Gradient Flow based on the Sliced Wasserstein Distance

2023-12-13 · Ilana Sebag, Muni Sreenivas Pydi, Jean-Yves Franceschi, Alain Rakotomamonjy 외

Safeguarding privacy in sensitive training data is paramount, particularly in the context of generative modeling. This can be achieved through either differentially private stochastic gradient descent or a differentially…

Transport information Bregman divergences

2021-01-04 · Wuchen Li

We study Bregman divergences in probability density space embedded with the $L^2$-Wasserstein metric. Several properties and dualities of transport Bregman divergences are provided. In particular, we derive the transport…