Revisiting Embeddings for Graph Neural Networks

2022-09-19 · S. Purchase, A. Zhao, R. D. Mullins

Current graph representation learning techniques use Graph Neural Networks (GNNs) to extract features from dataset embeddings. In this work, we examine the quality of these embeddings and assess how changing them can affect the accuracy of GNNs. We explore different embedding extraction techniques for both images and texts; and find that the performance of different GNN architectures is dependent on the embedding style used. We see a prevalence of bag of words (BoW) embeddings and text classification tasks in available graph datasets. Given the impact embeddings has on GNN performance. this leads to a phenomenon that GNNs being optimised for BoW vectors.

📄 PDF Abstract BibTeX arXiv:2209.09338

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Representation Learning Representation Learning text-classification Text Classification

Methods 이 논문이 사용한 방법론

GraphSAGE GraphSAGE is a general inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings for previously unseen…

Revisiting Semi-Supervised Learning with Graph Embeddings

2016-03-29 · Zhilin Yang, William W. Cohen, Ruslan Salakhutdinov

We present a semi-supervised learning framework based on graph embeddings. Given a graph between instances, we train an embedding for each instance to jointly predict the class label and the neighborhood context in the g…

Document Classification Entity Extraction using GAN General Classification Node Classification+1

Revisiting FastMap: New Applications

2025-03-14 · Ang Li

FastMap was first introduced in the Data Mining community for generating Euclidean embeddings of complex objects. In this dissertation, we first present FastMap to generate Euclidean embeddings of graphs in near-linear t…

Community Detection

Revisiting Graph Neural Networks for Link Prediction

2020-09-28 · Muhan Zhang, Pan Li, Yinglong Xia, Kai Wang 외

Graph neural networks (GNNs) have achieved great success in recent years. Three most common applications include node classification, link prediction, and graph classification. While there is rich literature on node clas…

Classification Graph Classification Link Prediction Node Classification+1

Revisiting Catastrophic Forgetting in Continual Knowledge Graph Embedding

2026-04-21 · Gerard Pons, Carlos Escolano, Besim Bilalli, Anna Queralt arxiv

Knowledge Graph Embeddings (KGEs) support a wide range of downstream tasks over Knowledge Graphs (KGs). In practice, KGs evolve as new entities and facts are added, motivating Continual Knowledge Graph Embedding (CKGE) m…

Knowledge Graph Embedding Knowledge Graphs

Revisiting Recurrent Networks for Paraphrastic Sentence Embeddings

2017-04-30 · ACL 2017 7 · John Wieting, Kevin Gimpel

We consider the problem of learning general-purpose, paraphrastic sentence embeddings, revisiting the setting of Wieting et al. (2016b). While they found LSTM recurrent networks to underperform word averaging, we present…

Sentence Sentence Embeddings Transfer Learning