paper-with-me

Papers

Unsupervised Ground Metric Learning using Wasserstein Singular Vectors

2021-02-11 · Geert-Jan Huizing, Laura Cantini, Gabriel Peyré

Defining meaningful distances between samples in a dataset is a fundamental problem in machine learning. Optimal Transport (OT) lifts a distance between features (the "ground metric") to a geometrically meaningful distance between samples. However, there is usually no straightforward choice of ground metric. Supervised ground metric learning approaches exist but require labeled data. In absence of labels, only ad-hoc ground metrics remain. Unsupervised ground metric learning is thus a fundamental problem to enable data-driven applications of OT. In this paper, we propose for the first time a canonical answer by simultaneously computing an OT distance between samples and between features of a dataset. These distance matrices emerge naturally as positive singular vectors of the function mapping ground metrics to OT distances. We provide criteria to ensure the existence and uniqueness of these singular vectors. We then introduce scalable computational methods to approximate them in high-dimensional settings, using stochastic approximation and entropic regularization. Finally, we showcase Wasserstein Singular Vectors on a single-cell RNA-sequencing dataset.

📄 PDF Abstract BibTeX arXiv:2102.06278

Code (1)

gjhuizing/wsingular 공식 구현 pytorch

Tasks

ClusteringDimensionality ReductionMetric Learning

Similar Papers 제목 키워드 기반

Fast unsupervised ground metric learning with tree-Wasserstein distance

2024-11-11 · Kira M. Düsterwald, Samo Hromadka, Makoto Yamada

The performance of unsupervised methods such as clustering depends on the choice of distance metric between features, or ground metric. Commonly, ground metrics are decided with heuristics or learned via supervised algor…

Metric Learning

Background Subtraction using Adaptive Singular Value Decomposition

2019-06-28 · Günther Reitberger, Tomas Sauer

An important task when processing sensor data is to distinguish relevant from irrelevant data. This paper describes a method for an iterative singular value decomposition that maintains a model of the background via sing…

Label Alignment Regularization for Distribution Shift

2022-11-27 · Ehsan Imani, Guojun Zhang, Runjia Li, Jun Luo 외

Recent work has highlighted the label alignment property (LAP) in supervised learning, where the vector of all labels in the dataset is mostly in the span of the top few singular vectors of the data matrix. Drawing inspi…

Domain AdaptationRepresentation LearningSentiment AnalysisUnsupervised Domain Adaptation

When Random Tensors meet Random Matrices

2021-12-23 · Mohamed El Amine Seddik, Maxime Guillaud, Romain Couillet

Relying on random matrix theory (RMT), this paper studies asymmetric order-$d$ spiked tensor models with Gaussian noise. Using the variational definition of the singular vectors and values of (Lim, 2005), we show that th…

LEMMA

(q,p)-Wasserstein GANs: Comparing Ground Metrics for Wasserstein GANs

2019-02-10 · Anton Mallasto, Jes Frellsen, Wouter Boomsma, Aasa Feragen

Generative Adversial Networks (GANs) have made a major impact in computer vision and machine learning as generative models. Wasserstein GANs (WGANs) brought Optimal Transport (OT) theory into GANs, by minimizing the $1$-…