paper-with-me

홈 › Papers

Entropy Partial Transport with Tree Metrics: Theory and Practice

2021-01-24 · Tam Le, Truyen Nguyen

Optimal transport (OT) theory provides powerful tools to compare probability measures. However, OT is limited to nonnegative measures having the same mass, and suffers serious drawbacks about its computation and statistics. This leads to several proposals of regularized variants of OT in the recent literature. In this work, we consider an \textit{entropy partial transport} (EPT) problem for nonnegative measures on a tree having different masses. The EPT is shown to be equivalent to a standard complete OT problem on a one-node extended tree. We derive its dual formulation, then leverage this to propose a novel regularization for EPT which admits fast computation and negative definiteness. To our knowledge, the proposed regularized EPT is the first approach that yields a \textit{closed-form} solution among available variants of unbalanced OT. For practical applications without priori knowledge about the tree structure for measures, we propose tree-sliced variants of the regularized EPT, computed by averaging the regularized EPT between these measures using random tree metrics, built adaptively from support data points. Exploiting the negative definiteness of our regularized EPT, we introduce a positive definite kernel, and evaluate it against other baselines on benchmark tasks such as document classification with word embedding and topological data analysis. In addition, we empirically demonstrate that our regularization also provides effective approximations.

📄 PDF Abstract BibTeX arXiv:2101.09756

Code (0)

등록된 구현이 없습니다.

Tasks

Document ClassificationTopological Data Analysis

Similar Papers 제목 키워드 기반

Tree-Sliced Variants of Wasserstein Distances

2019-02-01 · NeurIPS 2019 12 · Tam Le, Makoto Yamada, Kenji Fukumizu, Marco Cuturi

Optimal transport (\OT) theory defines a powerful set of tools to compare probability distributions. \OT~suffers however from a few drawbacks, computational and statistical, which have encouraged the proposal of several …

An Optimal Transport View on Generalization

2018-11-08 · Jingwei Zhang, Tongliang Liu, DaCheng Tao

We derive upper bounds on the generalization error of learning algorithms based on their \emph{algorithmic transport cost}: the expected Wasserstein distance between the output hypothesis and the output hypothesis condit…

Learning Theory

Prototypical Partial Optimal Transport for Universal Domain Adaptation

2024-08-02 · Yucheng Yang, Xiang Gu, Jian Sun

Universal domain adaptation (UniDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain without requiring the same label sets of both domains. The existence of domain and category shift …

Domain AdaptationUniversal Domain Adaptation

Entropy Regularized Optimal Transport Independence Criterion

2021-12-31 · Lang Liu, Soumik Pal, Zaid Harchaoui

We introduce an independence criterion based on entropy regularized optimal transport. Our criterion can be used to test for independence between two samples. We establish non-asymptotic bounds for our test statistic and…

Entropy-Tree: Tree-Based Decoding with Entropy-Guided Exploration

2026-01-02 · Longxuan Wei, Yubo Zhang, Zijiao Zhang, Zhihu Wang 외 arxiv

Large language models achieve strong reasoning performance, yet existing decoding strategies either explore blindly (random sampling) or redundantly (independent multi-sampling). We propose Entropy-Tree, a tree-based dec…