paper-with-me

홈 › Papers

Cycle Consistent Probability Divergences Across Different Spaces

2021-11-22 · Zhengxin Zhang, Youssef Mroueh, Ziv Goldfeld, Bharath K. Sriperumbudur

Discrepancy measures between probability distributions are at the core of statistical inference and machine learning. In many applications, distributions of interest are supported on different spaces, and yet a meaningful correspondence between data points is desired. Motivated to explicitly encode consistent bidirectional maps into the discrepancy measure, this work proposes a novel unbalanced Monge optimal transport formulation for matching, up to isometries, distributions on different spaces. Our formulation arises as a principled relaxation of the Gromov-Haussdroff distance between metric spaces, and employs two cycle-consistent maps that push forward each distribution onto the other. We study structural properties of the proposed discrepancy and, in particular, show that it captures the popular cycle-consistent generative adversarial network (GAN) framework as a special case, thereby providing the theory to explain it. Motivated by computational efficiency, we then kernelize the discrepancy and restrict the mappings to parametric function classes. The resulting kernelized version is coined the generalized maximum mean discrepancy (GMMD). Convergence rates for empirical estimation of GMMD are studied and experiments to support our theory are provided.

📄 PDF Abstract BibTeX arXiv:2111.11328

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyGenerative Adversarial Network

Similar Papers 제목 키워드 기반

LegalWorld: A Life-Cycle Interactive Environment for Legal Agents

2026-06-17 · Songhan Zuo, Shengbin Yue, Tao Chiang, Guanying Li 외 arxiv

Civil litigation is inherently a life-cycle process: what a lawyer drafts on day one constrains what unfolds at trial months later. Yet existing legal benchmarks evaluate isolated subtasks, and prior legal-agent simulato…

Kullback-Leibler and Renyi divergences in reproducing kernel Hilbert space and Gaussian process settings

2022-07-18 · Minh Ha Quang

In this work, we present formulations for regularized Kullback-Leibler and R\'enyi divergences via the Alpha Log-Determinant (Log-Det) divergences between positive Hilbert-Schmidt operators on Hilbert spaces in two diffe…

Gaussian Processes

BandPO: Bridging Trust Regions and Ratio Clipping via Probability-Aware Bounds for LLM Reinforcement Learning

2026-03-05 · Yuan Li, Bo Wang, Yufei Gao, Yuqian Yao 외 arxiv

Proximal constraints are fundamental to the stability of the Large Language Model reinforcement learning. While the canonical clipping mechanism in PPO serves as an efficient surrogate for trust regions, we identify a cr…

Reinforcement Learning

Sharp Inequalities for $f$-divergences

2013-02-02 · Adityanand Guntuboyina, Sujayam Saha, Geoffrey Schiebinger

$f$-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullbac…

$(f,Γ)$-Divergences: Interpolating between $f$-Divergences and Integral Probability Metrics

2020-11-11 · Jeremiah Birrell, Paul Dupuis, Markos A. Katsoulakis, Yannis Pantazis 외

We develop a rigorous and general framework for constructing information-theoretic divergences that subsume both $f$-divergences and integral probability metrics (IPMs), such as the $1$-Wasserstein distance. We prove und…

Image GenerationUncertainty Quantification