paper-with-me

홈 › Papers

Unsupervised Graph Representation Learning with Inductive Shallow Node Embedding

2024-07-12 · Complex & Intelligent Systems 2024 7 · Richárd Kiss, Gábor Szűcs

Network science has witnessed a surge in popularity, driven by the transformative power of node representation learning for diverse applications like social network analysis and biological modeling. While shallow embedding algorithms excel at capturing network structure, they face a critical limitation – failing to generalize to unseen nodes. This paper addresses this challenge by introducing Inductive Shallow Node Embedding – as a main contribution – pioneering a novel approach that extends shallow embeddings to the realm of inductive learning. It has a novel encoder architecture that captures the local neighborhood structure of each node, enabling effective generalization to unseen nodes. In the generalization, robustness is essential to avoid degradation of performance arising from noise in the dataset. It has been theoretically proven that the covariance of the additive noise term in the proposed model is inversely proportional to the cardinality of a node’s neighbors. Another contribution is a mathematical lower bound to quantify the robustness of node embeddings, confirming its advantage over traditional shallow embedding methods, particularly in the presence of parameter noise. The proposed method demonstrably excels in dynamic networks, consistently achieving over 90% performance on previously unseen nodes compared to nodes encountered during training on various benchmarks. The empirical evaluation concludes that our method outperforms competing methods on the vast majority of datasets in both transductive and inductive tasks.

📄 PDF Abstract BibTeX

Code (1)

ricsi98/inductive-shallow-node-embedding pytorch

Tasks

Graph Representation LearningInductive LearningNode ClassificationRepresentation Learning

Methods 이 논문이 사용한 방법론

ISNE Inductive Shallow Node Embedding extends shallow embeddings to the realm of inductive learning. It has a novel encoder architecture that captures the local neighborhood structure…

Similar Papers 제목 키워드 기반

AttrE2vec: Unsupervised Attributed Edge Representation Learning

2020-12-29 · Piotr Bielak, Tomasz Kajdanowicz, Nitesh V. Chawla

Representation learning has overcome the often arduous and manual featurization of networks through (unsupervised) feature learning as it results in embeddings that can apply to a variety of downstream learning tasks. Th…

ClusteringEdge ClassificationRepresentation Learning

Unsupervised Joint k-node Graph Representations with Compositional Energy-Based Models

2020-12-01 · NeurIPS 2020 12 · Leonardo Cotta, Carlos H. C. Teixeira, Ananthram Swami, Bruno Ribeiro

Existing Graph Neural Network (GNN) methods that learn inductive unsupervised graph representations focus on learning node and edge representations by predicting observed edges in the graph. Although such approaches have…

Graph Neural NetworkNode Classification

Unsupervised Joint $k$-node Graph Representations with Compositional Energy-Based Models

2020-10-08 · Leonardo Cotta, Carlos H. C. Teixeira, Ananthram Swami, Bruno Ribeiro

Existing Graph Neural Network (GNN) methods that learn inductive unsupervised graph representations focus on learning node and edge representations by predicting observed edges in the graph. Although such approaches have…

Graph Neural NetworkNode Classification

BIGSAGE: unsupervised inductive representation learning of graph via bi-attended sampling and global-biased aggregating

2019-05-01 · ICLR 2019 5 · Xin Luo, Hankz Hankui Zhuo

Different kinds of representation learning techniques on graph have shown significant effect in downstream machine learning tasks. Recently, in order to inductively learn representations for graph structures that is unob…

Representation LearningTransfer Learning

iN2V: Bringing Transductive Node Embeddings to Inductive Graphs

2025-06-05 · Nicolas Lell, Ansgar Scherp

Shallow node embeddings like node2vec (N2V) can be used for nodes without features or to supplement existing features with structure-based information. Embedding methods like N2V are limited in their application on new n…

Node ClassificationRepresentation Learning