paper-with-me

Papers

Hyperbolic Manifold Regression

2020-05-28 · Gian Maria Marconi, Lorenzo Rosasco, Carlo Ciliberto

Geometric representation learning has recently shown great promise in several machine learning settings, ranging from relational learning to language processing and generative models. In this work, we consider the problem of performing manifold-valued regression onto an hyperbolic space as an intermediate component for a number of relevant machine learning applications. In particular, by formulating the problem of predicting nodes of a tree as a manifold regression task in the hyperbolic space, we propose a novel perspective on two challenging tasks: 1) hierarchical classification via label embeddings and 2) taxonomy extension of hyperbolic representations. To address the regression problem we consider previous methods as well as proposing two novel approaches that are computationally more advantageous: a parametric deep learning model that is informed by the geodesics of the target space and a non-parametric kernel-method for which we also prove excess risk bounds. Our experiments show that the strategy of leveraging the hyperbolic geometry is promising. In particular, in the taxonomy expansion setting, we find that the hyperbolic-based estimators significantly outperform methods performing regression in the ambient Euclidean space.

📄 PDF Abstract BibTeX arXiv:2005.13885

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningregressionRelational ReasoningRepresentation LearningTaxonomy Expansion

Similar Papers 제목 키워드 기반

Matrix Manifold Neural Networks++

2024-05-29 · Xuan Son Nguyen, Shuo Yang, Aymeric Histace

Deep neural networks (DNNs) on Riemannian manifolds have garnered increasing interest in various applied areas. For instance, DNNs on spherical and hyperbolic manifolds have been designed to solve a wide range of compute…

Action RecognitionNode ClassificationTemporal Action Localization

A Hyperbolic-to-Hyperbolic Graph Convolutional Network

2021-04-14 · CVPR 2021 1 · Jindou Dai, Yuwei Wu, Zhi Gao, Yunde Jia

Hyperbolic graph convolutional networks (GCNs) demonstrate powerful representation ability to model graphs with hierarchical structure. Existing hyperbolic GCNs resort to tangent spaces to realize graph convolution on hy…

General ClassificationGraph ClassificationLink PredictionNode Classification

Mixed-curvature decision trees and random forests

2024-10-03 · Philippe Chlenski, Quentin Chu, Raiyan R. Khan, Kaizhu Du 외

Decision trees (DTs) and their random forest (RF) extensions are workhorses of classification and regression in Euclidean spaces. However, algorithms for learning in non-Euclidean spaces are still limited. We extend DT a…

Link Predictionregression

Low-rank approximations of hyperbolic embeddings

2019-03-18 · Pratik Jawanpuria, Mayank Meghwanshi, Bamdev Mishra

The hyperbolic manifold is a smooth manifold of negative constant curvature. While the hyperbolic manifold is well-studied in the literature, it has gained interest in the machine learning and natural language processing…

Hyperbolic Busemann Learning with Ideal Prototypes

2021-06-28 · NeurIPS 2021 12 · Mina Ghadimi Atigh, Martin Keller-Ressel, Pascal Mettes

Hyperbolic space has become a popular choice of manifold for representation learning of various datatypes from tree-like structures and text to graphs. Building on the success of deep learning with prototypes in Euclidea…

PositionRepresentation Learning