paper-with-me

Papers

Adaptive Diffusion in Graph Neural Networks

2021-12-01 · NeurIPS 2021 12 · Jialin Zhao, Yuxiao Dong, Ming Ding, Evgeny Kharlamov, Jie Tang

The success of graph neural networks (GNNs) largely relies on the process of aggregating information from neighbors defined by the input graph structures. Notably, message passing based GNNs, e.g., graph convolutional networks, leverage the immediate neighbors of each node during the aggregation process, and recently, graph diffusion convolution (GDC) is proposed to expand the propagation neighborhood by leveraging generalized graph diffusion. However, the neighborhood size in GDC is manually tuned for each graph by conducting grid search over the validation set, making its generalization practically limited. To address this issue, we propose the adaptive diffusion convolution (ADC) strategy to automatically learn the optimal neighborhood size from the data. Furthermore, we break the conventional assumption that all GNN layers and feature channels (dimensions) should use the same neighborhood for propagation. We design strategies to enable ADC to learn a dedicated propagation neighborhood for each GNN layer and each feature channel, making the GNN architecture fully coupled with graph structures---the unique property that differs GNNs from traditional neural networks. By directly plugging ADC into existing GNNs, we observe consistent and significant outperformance over both GDC and their vanilla versions across various datasets, demonstrating the improved model capacity brought by automatically learning unique neighborhood size per layer and per channel in GNNs.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Hypergraph Neural Diffusion: A PDE-Inspired Framework for Hypergraph Message Passing

2026-04-13 · Zhiheng Zhou, Mengyao Zhou, Xixun Lin, Xingqin Qi 외 arxiv

Hypergraph neural networks (HGNNs) have shown remarkable potential in modeling high-order relationships that naturally arise in many real-world data domains. However, existing HGNNs often suffer from shallow propagation,…

Cross-Domain Graph Data Scaling: A Showcase with Diffusion Models

2024-06-04 · Wenzhuo Tang, Haitao Mao, Danial Dervovic, Ivan Brugere 외

Models for natural language and images benefit from data scaling behavior: the more data fed into the model, the better they perform. This 'better with more' phenomenon enables the effectiveness of large-scale pre-traini…

Cross-Domain Diffusion with Progressive Alignment for Efficient Adaptive Retrieval

2025-05-20 · Junyu Luo, Yusheng Zhao, Xiao Luo, Zhiping Xiao 외

Unsupervised efficient domain adaptive retrieval aims to transfer knowledge from a labeled source domain to an unlabeled target domain, while maintaining low storage cost and high retrieval efficiency. However, existing …

Domain AdaptationRetrieval

Factual and Edit-Sensitive Graph-to-Sequence Generation via Graph-Aware Adaptive Noising

2026-04-27 · Aditya Hemant Shahane, Anuj Kumar Sirohi, Tanmoy Chakraborty, Prathosh A P 외 arxiv

Fine-tuned autoregressive models for graph-to-sequence generation (G2S) often struggle with factual grounding and edit sensitivity. To tackle these issues, we propose a non-autoregressive diffusion framework that generat…

Molecule Captioning

Class-Attentive Diffusion Network for Semi-Supervised Classification

2020-06-18 · Jongin Lim, Daeho Um, Hyung Jin Chang, Dae Ung Jo 외

Recently, graph neural networks for semi-supervised classification have been widely studied. However, existing methods only use the information of limited neighbors and do not deal with the inter-class connections in gra…

ClassificationGeneral Classification