paper-with-me

홈 › Papers

Inductive Representation Learning in Large Attributed Graphs

2017-10-25 · Nesreen K. Ahmed, Ryan A. Rossi, Rong Zhou, John Boaz Lee, Xiangnan Kong, Theodore L. Willke, Hoda Eldardiry

Graphs (networks) are ubiquitous and allow us to model entities (nodes) and the dependencies (edges) between them. Learning a useful feature representation from graph data lies at the heart and success of many machine learning tasks such as classification, anomaly detection, link prediction, among many others. Many existing techniques use random walks as a basis for learning features or estimating the parameters of a graph model for a downstream prediction task. Examples include recent node embedding methods such as DeepWalk, node2vec, as well as graph-based deep learning algorithms. However, the simple random walk used by these methods is fundamentally tied to the identity of the node. This has three main disadvantages. First, these approaches are inherently transductive and do not generalize to unseen nodes and other graphs. Second, they are not space-efficient as a feature vector is learned for each node which is impractical for large graphs. Third, most of these approaches lack support for attributed graphs. To make these methods more generally applicable, we propose a framework for inductive network representation learning based on the notion of attributed random walk that is not tied to node identity and is instead based on learning a function $\Phi : \mathrm{\rm \bf x} \rightarrow w$ that maps a node attribute vector $\mathrm{\rm \bf x}$ to a type $w$. This framework serves as a basis for generalizing existing methods such as DeepWalk, node2vec, and many other previous methods that leverage traditional random walks.

📄 PDF Abstract BibTeX arXiv:1710.09471

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionAttributeLink PredictionRepresentation Learning

Methods 이 논문이 사용한 방법론

DeepWalk DeepWalk learns embeddings (social representations) of a graph's vertices, by modeling a stream of short random walks. Social representations are latent features of the…
node2vec node2vec is a framework for learning graph embeddings for nodes in graphs. Node2vec maximizes a likelihood objective over mappings which preserve neighbourhood distances in…

Similar Papers 제목 키워드 기반

Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Ranking

2017-07-12 · ICLR 2018 1 · Aleksandar Bojchevski, Stephan Günnemann

Methods that learn representations of nodes in a graph play a critical role in network analysis since they enable many downstream learning tasks. We propose Graph2Gauss - an approach that can efficiently learn versatile …

Inductive LearningLink PredictionNetwork EmbeddingNode Classification

GraphSAINT: Graph Sampling Based Inductive Learning Method

2019-07-10 · ICLR 2020 1 · Hanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan 외

Graph Convolutional Networks (GCNs) are powerful models for learning representations of attributed graphs. To scale GCNs to large graphs, state-of-the-art methods use various layer sampling techniques to alleviate the "n…

Graph AttentionGraph EmbeddingGraph Representation LearningGraph Sampling+3

Hierarchical and Unsupervised Graph Representation Learning with Loukas's Coarsening

2020-07-07 · Louis Béthune, Yacouba Kaloga, Pierre Borgnat, Aurélien Garivier 외

We propose a novel algorithm for unsupervised graph representation learning with attributed graphs. It combines three advantages addressing some current limitations of the literature: i) The model is inductive: it can em…

Graph Representation LearningRepresentation Learning

Fast-and-Frugal Text-Graph Transformers are Effective Link Predictors

2024-08-13 · Andrei C. Coman, Christos Theodoropoulos, Marie-Francine Moens, James Henderson

We propose Fast-and-Frugal Text-Graph (FnF-TG) Transformers, a Transformer-based framework that unifies textual and structural information for inductive link prediction in text-attributed knowledge graphs. We demonstrate…

Inductive LearningInductive Link PredictionKnowledge GraphsLink Prediction

AttrE2vec: Unsupervised Attributed Edge Representation Learning

2020-12-29 · Piotr Bielak, Tomasz Kajdanowicz, Nitesh V. Chawla

Representation learning has overcome the often arduous and manual featurization of networks through (unsupervised) feature learning as it results in embeddings that can apply to a variety of downstream learning tasks. Th…

ClusteringEdge ClassificationRepresentation Learning