paper-with-me

Papers

Supervised Tree-Wasserstein Distance

2021-01-27 · Yuki Takezawa, Ryoma Sato, Makoto Yamada

To measure the similarity of documents, the Wasserstein distance is a powerful tool, but it requires a high computational cost. Recently, for fast computation of the Wasserstein distance, methods for approximating the Wasserstein distance using a tree metric have been proposed. These tree-based methods allow fast comparisons of a large number of documents; however, they are unsupervised and do not learn task-specific distances. In this work, we propose the Supervised Tree-Wasserstein (STW) distance, a fast, supervised metric learning method based on the tree metric. Specifically, we rewrite the Wasserstein distance on the tree metric by the parent-child relationships of a tree and formulate it as a continuous optimization problem using a contrastive loss. Experimentally, we show that the STW distance can be computed fast, and improves the accuracy of document classification tasks. Furthermore, the STW distance is formulated by matrix multiplications, runs on a GPU, and is suitable for batch processing. Therefore, we show that the STW distance is extremely efficient when comparing a large number of documents.

📄 PDF Abstract BibTeX arXiv:2101.11520

Code (0)

등록된 구현이 없습니다.

Tasks

Document ClassificationGPUMetric Learning

Similar Papers 제목 키워드 기반

An Empirical Study of Self-supervised Learning with Wasserstein Distance

2023-10-16 · Makoto Yamada, Yuki Takezawa, Guillaume Houry, Kira Michaela Dusterwald 외

In this study, we delve into the problem of self-supervised learning (SSL) utilizing the 1-Wasserstein distance on a tree structure (a.k.a., Tree-Wasserstein distance (TWD)), where TWD is defined as the L1 distance betwe…

Representation LearningSelf-Supervised Learning

Fast unsupervised ground metric learning with tree-Wasserstein distance

2024-11-11 · Kira M. Düsterwald, Samo Hromadka, Makoto Yamada

The performance of unsupervised methods such as clustering depends on the choice of distance metric between features, or ground metric. Commonly, ground metrics are decided with heuristics or learned via supervised algor…

Metric Learning

Approximating 1-Wasserstein Distance with Trees

2022-06-24 · Makoto Yamada, Yuki Takezawa, Ryoma Sato, Han Bao 외

Wasserstein distance, which measures the discrepancy between distributions, shows efficacy in various types of natural language processing (NLP) and computer vision (CV) applications. One of the challenges in estimating …

Coupled Hierarchical Structure Learning using Tree-Wasserstein Distance

2025-01-07 · Ya-Wei Eileen Lin, Ronald R. Coifman, Gal Mishne, Ronen Talmon

In many applications, both data samples and features have underlying hierarchical structures. However, existing methods for learning these latent structures typically focus on either samples or features, ignoring possibl…

Link PredictionNode Classification

Fixed Support Tree-Sliced Wasserstein Barycenter

2021-09-08 · Yuki Takezawa, Ryoma Sato, Zornitsa Kozareva, Sujith Ravi 외

The Wasserstein barycenter has been widely studied in various fields, including natural language processing, and computer vision. However, it requires a high computational cost to solve the Wasserstein barycenter problem…