paper-with-me

홈 › Papers

Teleport Graph Convolutional Networks

2021-01-01 · Hongyang Gao, Shuiwang Ji

We consider the limitations in message-passing graph neural networks. In message-passing operations, each node aggregates information from its neighboring nodes. To enlarge the receptive field, graph neural networks need to stack multiple message-passing graph convolution layers, which leads to the over-fitting issue and over-smoothing issue. To address these limitations, we propose a teleport graph convolution layer (TeleGCL) that uses teleport functions to enable each node to aggregate information from a much larger neighborhood. For each node, teleport functions select relevant nodes beyond the local neighborhood, thereby resulting in a larger receptive field. To apply our structure-aware teleport function, we propose a novel method to construct structural features for nodes in the graph. Based on our TeleGCL, we build a family of teleport graph convolutional networks. The empirical results on graph and node classification tasks demonstrate the effectiveness of our proposed methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Node Classification

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Teleportation With Null Space Gradient Projection for Optimization Acceleration

2025-02-17 · Zihao Wu, Juncheng Dong, Ahmed Aloui, Vahid Tarokh

Optimization techniques have become increasingly critical due to the ever-growing model complexity and data scale. In particular, teleportation has emerged as a promising approach, which accelerates convergence of gradie…

BHGNN-RT: Network embedding for directed heterogeneous graphs

2023-11-24 · Xiyang Sun, Fumiyasu Komaki

Networks are one of the most valuable data structures for modeling problems in the real world. However, the most recent node embedding strategies have focused on undirected graphs, with limited attention to directed grap…

Graph Neural NetworkNetwork EmbeddingNode Classification

Teleporter Theory: A General and Simple Approach for Modeling Cross-World Counterfactual Causality

2024-06-17 · Jiangmeng Li, Bin Qin, Qirui Ji, Yi Li 외

Leveraging the development of structural causal model (SCM), researchers can establish graphical models for exploring the causal mechanisms behind machine learning techniques. As the complexity of machine learning applic…

counterfactual

Level Set Teleportation: An Optimization Perspective

2024-03-05 · Aaron Mishkin, Alberto Bietti, Robert M. Gower

We study level set teleportation, an optimization routine which tries to accelerate gradient descent (GD) by maximizing the gradient norm over a level set of the objective. While teleportation intuitively speeds-up GD vi…

LEMMA

Neural Teleportation

2020-12-02 · Marco Armenta, Thierry Judge, Nathan Painchaud, Youssef Skandarani 외

In this paper, we explore a process called neural teleportation, a mathematical consequence of applying quiver representation theory to neural networks. Neural teleportation "teleports" a network to a new position in the…

Position