paper-with-me

Papers

Regularity as Regularization: Smooth and Strongly Convex Brenier Potentials in Optimal Transport

2019-05-26 · François-Pierre Paty, Alexandre d'Aspremont, Marco Cuturi

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is comparable to the distance between the original densities. Therefore, optimal transport (OT) can only be used in machine learning if it is substantially regularized. On the other hand, one of the greatest achievements of the OT literature in recent years lies in regularity theory: Caffarelli showed that the OT map between two well behaved measures is Lipschitz, or equivalently when considering 2-Wasserstein distances, that Brenier convex potentials (whose gradient yields an optimal map) are smooth. We propose in this work to draw inspiration from this theory and use regularity as a regularization tool. We give algorithms operating on two discrete measures that can recover nearly optimal transport maps with small distortion, or equivalently, nearly optimal Brenier potentials that are strongly convex and smooth. The problem boils down to solving alternatively a convex QCQP and a discrete OT problem, granting access to the values and gradients of the Brenier potential not only on sampled points, but also out of sample at the cost of solving a simpler QCQP for each evaluation. We propose algorithms to estimate and evaluate transport maps with desired regularity properties, benchmark their statistical performance, apply them to domain adaptation and visualize their action on a color transfer task.

📄 PDF Abstract BibTeX arXiv:1905.10812

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Adaptation

Similar Papers 제목 키워드 기반

Plugin Estimation of Smooth Optimal Transport Maps

2021-07-26 · Tudor Manole, Sivaraman Balakrishnan, Jonathan Niles-Weed, Larry Wasserman

We analyze a number of natural estimators for the optimal transport map between two distributions and show that they are minimax optimal. We adopt the plugin approach: our estimators are simply optimal couplings between …

Mode Collapse and Regularity of Optimal Transportation Maps

2019-02-08 · Na lei, Yang Guo, Dongsheng An, Xin Qi 외

This work builds the connection between the regularity theory of optimal transportation map, Monge-Amp\`{e}re equation and GANs, which gives a theoretic understanding of the major drawbacks of GANs: convergence difficult…

Statistical Convergence Rates of Optimal Transport Map Estimation between General Distributions

2024-12-11 · Yizhe Ding, Runze Li, Lingzhou Xue

This paper studies the convergence rates of optimal transport (OT) map estimators, a topic of growing interest in statistics, machine learning, and various scientific fields. Despite recent advancements, existing results…

On Differentially Private Stochastic Convex Optimization with Heavy-tailed Data

2020-10-21 · ICML 2020 1 · Di Wang, Hanshen Xiao, Srini Devadas, Jinhui Xu

In this paper, we consider the problem of designing Differentially Private (DP) algorithms for Stochastic Convex Optimization (SCO) on heavy-tailed data. The irregularity of such data violates some key assumptions used i…

Accelerated Randomized Mirror Descent Algorithms For Composite Non-strongly Convex Optimization

2016-05-23 · Le Thi Khanh Hien, Cuong V. Nguyen, Huan Xu, Can-Yi Lu 외

We consider the problem of minimizing the sum of an average function of a large number of smooth convex components and a general, possibly non-differentiable, convex function. Although many methods have been proposed to …