paper-with-me

홈 › Papers

Graph Classification via Reference Distribution Learning: Theory and Practice

2024-08-21 · Zixiao Wang, Jicong Fan

Graph classification is a challenging problem owing to the difficulty in quantifying the similarity between graphs or representing graphs as vectors, though there have been a few methods using graph kernels or graph neural networks (GNNs). Graph kernels often suffer from computational costs and manual feature engineering, while GNNs commonly utilize global pooling operations, risking the loss of structural or semantic information. This work introduces Graph Reference Distribution Learning (GRDL), an efficient and accurate graph classification method. GRDL treats each graph's latent node embeddings given by GNN layers as a discrete distribution, enabling direct classification without global pooling, based on maximum mean discrepancy to adaptively learned reference distributions. To fully understand this new model (the existing theories do not apply) and guide its configuration (e.g., network architecture, references' sizes, number, and regularization) for practical use, we derive generalization error bounds for GRDL and verify them numerically. More importantly, our theoretical and numerical results both show that GRDL has a stronger generalization ability than GNNs with global pooling operations. Experiments on moderate-scale and large-scale graph datasets show the superiority of GRDL over the state-of-the-art, emphasizing its remarkable efficiency, being at least 10 times faster than leading competitors in both training and inference stages.

📄 PDF Abstract BibTeX arXiv:2408.11370

Code (0)

등록된 구현이 없습니다.

Tasks

Feature EngineeringGraph ClassificationLearning Theory

Similar Papers 제목 키워드 기반

Metric Elicitation; Moving from Theory to Practice

2022-12-07 · Safinah Ali, Sohini Upadhyay, Gaurush Hiranandani, Elena L. Glassman 외

Metric Elicitation (ME) is a framework for eliciting classification metrics that better align with implicit user preferences based on the task and context. The existing ME strategy so far is based on the assumption that …

Binary ClassificationClassification

Fundamental Limits of Deep Graph Convolutional Networks

2019-10-28 · Abram Magner, Mayank Baranwal, Alfred O. Hero III

Graph convolutional networks (GCNs) are a widely used method for graph representation learning. To elucidate the capabilities and limitations of GCNs, we investigate their power, as a function of their number of layers, …

Graph ClassificationGraph Representation LearningRepresentation Learning

Graph Federated Learning with Hidden Representation Sharing

2022-12-23 · Shuang Wu, Mingxuan Zhang, Yuantong Li, Carl Yang 외

Learning on Graphs (LoG) is widely used in multi-client systems when each client has insufficient local data, and multiple clients have to share their raw data to learn a model of good quality. One scenario is to recomme…

Federated Learning

Learning on Random Balls is Sufficient for Estimating (Some) Graph Parameters

2021-11-05 · NeurIPS 2021 12 · Takanori Maehara, Hoang NT

Theoretical analyses for graph learning methods often assume a complete observation of the input graph. Such an assumption might not be useful for handling any-size graphs due to the scalability issues in practice. In th…

ClassificationGeneralization BoundsGraph ClassificationGraph Learning

MixDPO: Modeling Preference Strength for Pluralistic Alignment

2026-01-07 · Saki Imai, Pedram Heydari, Anthony Sicilia, Asteria Kaeberlein 외 arxiv

Preference based alignment objectives implicitly assume that all human preferences are expressed with equal strength. In practice, however, preference strength varies across individuals and contexts -- a phenomenon estab…