paper-with-me

홈 › Papers

HyperAid: Denoising in hyperbolic spaces for tree-fitting and hierarchical clustering

2022-05-19 · Eli Chien, Puoya Tabaghi, Olgica Milenkovic

The problem of fitting distances by tree-metrics has received significant attention in the theoretical computer science and machine learning communities alike, due to many applications in natural language processing, phylogeny, cancer genomics and a myriad of problem areas that involve hierarchical clustering. Despite the existence of several provably exact algorithms for tree-metric fitting of data that inherently obeys tree-metric constraints, much less is known about how to best fit tree-metrics for data whose structure moderately (or substantially) differs from a tree. For such noisy data, most available algorithms perform poorly and often produce negative edge weights in representative trees. Furthermore, it is currently not known how to choose the most suitable approximation objective for noisy fitting. Our contributions are as follows. First, we propose a new approach to tree-metric denoising (HyperAid) in hyperbolic spaces which transforms the original data into data that is ``more'' tree-like, when evaluated in terms of Gromov's $\delta$ hyperbolicity. Second, we perform an ablation study involving two choices for the approximation objective, $\ell_p$ norms and the Dasgupta loss. Third, we integrate HyperAid with schemes for enforcing nonnegative edge-weights. As a result, the HyperAid platform outperforms all other existing methods in the literature, including Neighbor Joining (NJ), TreeRep and T-REX, both on synthetic and real-world data. Synthetic data is represented by edge-augmented trees and shortest-distance metrics while the real-world datasets include Zoo, Iris, Glass, Segmentation and SpamBase; on these datasets, the average improvement with respect to NJ is $125.94\%$.

📄 PDF Abstract BibTeX arXiv:2205.09721

Code (1)

elichienxd/hyperaid 공식 구현 pytorch

Tasks

ClusteringDenoising

Similar Papers 제목 키워드 기반

Fitting trees to $\ell_1$-hyperbolic distances

2024-09-02 · NeurIPS 2023 11 · Joon-Hyeok Yim, Anna C. Gilbert

Building trees to represent or to fit distances is a critical component of phylogenetic analysis, metric embeddings, approximation algorithms, geometric graph neural nets, and the analysis of hierarchical data. Much of t…

Neural Networks in a Product of Hyperbolic Spaces

2022-07-01 · NAACL (ACL) 2022 7 · Jun Takeuchi, Noriki Nishida, Hideki Nakayama

Machine learning in hyperbolic spaces has attracted much attention in natural language processing and many other fields. In particular, Hyperbolic Neural Networks (HNNs) have improved a wide variety of tasks, from machin…

Graph EmbeddingKnowledge Graph EmbeddingMachine TranslationNode Classification

Laplacian Eigenspaces, Horocycles and Neuron Models on Hyperbolic Spaces

2021-01-01 · Ming-Xi Wang

We use hyperbolic Poisson kernel to construct the horocycle neuron model on hyperbolic spaces, which is a spectral generalization of the classical neuron model. We prove a universal approximation theorem for horocycle ne…

Accelerating hyperbolic t-SNE

2024-01-23 · Martin Skrodzki, Hunter van Geffen, Nicolas F. Chaves-de-Plaza, Thomas Höllt 외

The need to understand the structure of hierarchical or high-dimensional data is present in a variety of fields. Hyperbolic spaces have proven to be an important tool for embedding computations and analysis tasks as thei…

Dimensionality Reduction

Hyperbolic Neural Networks

2018-05-23 · NeurIPS 2018 12 · Octavian-Eugen Ganea, Gary Bécigneul, Thomas Hofmann

Hyperbolic spaces have recently gained momentum in the context of machine learning due to their high capacity and tree-likeliness properties. However, the representational power of hyperbolic geometry is not yet on par w…

Graph Representation LearningNatural Language InferenceSentenceSentence Embeddings