paper-with-me

Papers

Tree-Wasserstein Distance for High Dimensional Data with a Latent Feature Hierarchy

2024-10-28 · Ya-Wei Eileen Lin, Ronald R. Coifman, Gal Mishne, Ronen Talmon

Finding meaningful distances between high-dimensional data samples is an important scientific task. To this end, we propose a new tree-Wasserstein distance (TWD) for high-dimensional data with two key aspects. First, our TWD is specifically designed for data with a latent feature hierarchy, i.e., the features lie in a hierarchical space, in contrast to the usual focus on embedding samples in hyperbolic space. Second, while the conventional use of TWD is to speed up the computation of the Wasserstein distance, we use its inherent tree as a means to learn the latent feature hierarchy. The key idea of our method is to embed the features into a multi-scale hyperbolic space using diffusion geometry and then present a new tree decoding method by establishing analogies between the hyperbolic embedding and trees. We show that our TWD computed based on data observations provably recovers the TWD defined with the latent feature hierarchy and that its computation is efficient and scalable. We showcase the usefulness of the proposed TWD in applications to word-document and single-cell RNA-sequencing datasets, demonstrating its advantages over existing TWDs and methods based on pre-trained models.

📄 PDF Abstract BibTeX arXiv:2410.21107

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Tree-Sliced Variants of Wasserstein Distances

2019-02-01 · NeurIPS 2019 12 · Tam Le, Makoto Yamada, Kenji Fukumizu, Marco Cuturi

Optimal transport (\OT) theory defines a powerful set of tools to compare probability distributions. \OT~suffers however from a few drawbacks, computational and statistical, which have encouraged the proposal of several …

Supervised Tree-Wasserstein Distance

2021-01-27 · Yuki Takezawa, Ryoma Sato, Makoto Yamada

To measure the similarity of documents, the Wasserstein distance is a powerful tool, but it requires a high computational cost. Recently, for fast computation of the Wasserstein distance, methods for approximating the Wa…

Document ClassificationGPUMetric Learning

Adaptive Tree Wasserstein Minimization for Hierarchical Generative Modeling

2021-01-01 · ZiHao Wang, Xu Zhao, Tam Le, Hao Wu 외

Optimal Transport(OT) is a machine learning problem with applications including distribution comparison, generative adversarial networks, unsupervised domain adaptation, and to name a few. For deep learning literatures, …

Domain AdaptationUnsupervised Domain Adaptation

Tree-Sliced Wasserstein Distance: A Geometric Perspective

2024-06-19 · Viet-Hoang Tran, Trang Pham, Tho Tran, Minh Khoi Nguyen Nhat 외

Many variants of Optimal Transport (OT) have been developed to address its heavy computation. Among them, notably, Sliced Wasserstein (SW) is widely used for application domains by projecting the OT problem onto one-dime…

Computational EfficiencyStyle Transfer

Fixed Support Tree-Sliced Wasserstein Barycenter

2021-09-08 · Yuki Takezawa, Ryoma Sato, Zornitsa Kozareva, Sujith Ravi 외

The Wasserstein barycenter has been widely studied in various fields, including natural language processing, and computer vision. However, it requires a high computational cost to solve the Wasserstein barycenter problem…