paper-with-me

Papers

Improving Heterogeneous Graph Learning with Weighted Mixed-Curvature Product Manifold

2023-07-10 · Tuc Nguyen-Van, Dung D. Le, The-Anh Ta

In graph representation learning, it is important that the complex geometric structure of the input graph, e.g. hidden relations among nodes, is well captured in embedding space. However, standard Euclidean embedding spaces have a limited capacity in representing graphs of varying structures. A promising candidate for the faithful embedding of data with varying structure is product manifolds of component spaces of different geometries (spherical, hyperbolic, or euclidean). In this paper, we take a closer look at the structure of product manifold embedding spaces and argue that each component space in a product contributes differently to expressing structures in the input graph, hence should be weighted accordingly. This is different from previous works which consider the roles of different components equally. We then propose WEIGHTED-PM, a data-driven method for learning embedding of heterogeneous graphs in weighted product manifolds. Our method utilizes the topological information of the input graph to automatically determine the weight of each component in product spaces. Extensive experiments on synthetic and real-world graph datasets demonstrate that WEIGHTED-PM is capable of learning better graph representations with lower geometric distortion from input data, and performs better on multiple downstream tasks, such as word similarity learning, top-$k$ recommendation, and knowledge graph embedding.

📄 PDF Abstract BibTeX arXiv:2307.04514

Code (1)

sharecodesubmission/weighted_product_manifold 공식 구현 pytorch

Tasks

Graph EmbeddingGraph LearningGraph Representation LearningKnowledge Graph EmbeddingRepresentation LearningWord Similarity

Similar Papers 제목 키워드 기반

Mixed-Curvature Multi-Relational Graph Neural Network for Knowledge Graph Completion

2021-04-19 · WWW 2021 4 · Shen Wang∗

Knowledge graphs (KGs) have gradually become valuable assets for many AI applications. In a KG, a node denotes an entity, and an edge (or link) denotes a relationship between the entities represented by the nodes. Knowle…

Graph Neural NetworkKnowledge Graph CompletionKnowledge Graph EmbeddingsKnowledge Graphs

Mixed-curvature decision trees and random forests

2024-10-03 · Philippe Chlenski, Quentin Chu, Raiyan R. Khan, Kaizhu Du 외

Decision trees (DTs) and their random forest (RF) extensions are workhorses of classification and regression in Euclidean spaces. However, algorithms for learning in non-Euclidean spaces are still limited. We extend DT a…

Link Predictionregression

Product Manifold Representations for Learning on Biological Pathways

2024-01-27 · Daniel McNeela, Frederic Sala, Anthony Gitter

Machine learning models that embed graphs in non-Euclidean spaces have shown substantial benefits in a variety of contexts, but their application has not been studied extensively in the biological domain, particularly wi…

Graph Neural NetworkGraph Representation LearningRepresentation Learning

GraphMoRE: Mitigating Topological Heterogeneity via Mixture of Riemannian Experts

2024-12-15 · Zihao Guo, Qingyun Sun, Haonan Yuan, Xingcheng Fu 외

Real-world graphs have inherently complex and diverse topological patterns, known as topological heterogeneity. Most existing works learn graph representation in a single constant curvature space that is insufficient to …

Contrastive Graph Clustering in Curvature Spaces

2023-05-05 · Li Sun, Feiyang Wang, Junda Ye, Hao Peng 외

Graph clustering is a longstanding research topic, and has achieved remarkable success with the deep learning methods in recent years. Nevertheless, we observe that several important issues largely remain open. On the on…

ClusteringContrastive LearningGraph Clustering