paper-with-me

Papers

Statistical and Topological Properties of Gaussian Smoothed Sliced Probability Divergences

2021-10-20 · Alain Rakotomamonjy, Mokhtar Z. Alaya, Maxime Berar, Gilles Gasso

Gaussian smoothed sliced Wasserstein distance has been recently introduced for comparing probability distributions, while preserving privacy on the data. It has been shown, in applications such as domain adaptation, to provide performances similar to its non-private (non-smoothed) counterpart. However, the computational and statistical properties of such a metric is not yet been well-established. In this paper, we analyze the theoretical properties of this distance as well as those of generalized versions denoted as Gaussian smoothed sliced divergences. We show that smoothing and slicing preserve the metric property and the weak topology. We also provide results on the sample complexity of such divergences. Since, the privacy level depends on the amount of Gaussian smoothing, we analyze the impact of this parameter on the divergence. We support our theoretical findings with empirical studies of Gaussian smoothed and sliced version of Wassertein distance, Sinkhorn divergence and maximum mean discrepancy (MMD). In the context of privacy-preserving domain adaptation, we confirm that those Gaussian smoothed sliced Wasserstein and MMD divergences perform very well while ensuring data privacy.

📄 PDF Abstract BibTeX arXiv:2110.10524

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationPrivacy Preserving

Similar Papers 제목 키워드 기반

Gaussian-Smoothed Sliced Probability Divergences

2024-04-04 · Mokhtar Z. Alaya, Alain Rakotomamonjy, Maxime Berar, Gilles Gasso

Gaussian smoothed sliced Wasserstein distance has been recently introduced for comparing probability distributions, while preserving privacy on the data. It has been shown that it provides performances similar to its non…

Domain AdaptationPrivacy Preserving

Statistical and Topological Properties of Sliced Probability Divergences

2020-03-12 · NeurIPS 2020 12 · Kimia Nadjahi, Alain Durmus, Lénaïc Chizat, Soheil Kolouri 외

The idea of slicing divergences has been proven to be successful when comparing two probability measures in various machine learning applications including generative modeling, and consists in computing the expected valu…

Markovian Sliced Wasserstein Distances: Beyond Independent Projections

2023-01-10 · NeurIPS 2023 11 · Khai Nguyen, Tongzheng Ren, Nhat Ho

Sliced Wasserstein (SW) distance suffers from redundant projections due to independent uniform random projecting directions. To partially overcome the issue, max K sliced Wasserstein (Max-K-SW) distance ($K\geq 1$), seek…

Smooth $p$-Wasserstein Distance: Structure, Empirical Approximation, and Statistical Applications

2021-01-11 · Sloan Nietert, Ziv Goldfeld, Kengo Kato

Discrepancy measures between probability distributions, often termed statistical distances, are ubiquitous in probability theory, statistics and machine learning. To combat the curse of dimensionality when estimating the…

Two-sample testing

Sliced Wasserstein with Random-Path Projecting Directions

2024-01-29 · Khai Nguyen, Shujian Zhang, Tam Le, Nhat Ho

Slicing distribution selection has been used as an effective technique to improve the performance of parameter estimators based on minimizing sliced Wasserstein distance in applications. Previous works either utilize exp…

Denoising