paper-with-me

홈 › Papers

High-Order Pooling for Graph Neural Networks with Tensor Decomposition

2022-05-24 · Chenqing Hua, Guillaume Rabusseau, Jian Tang

Graph Neural Networks (GNNs) are attracting growing attention due to their effectiveness and flexibility in modeling a variety of graph-structured data. Exiting GNN architectures usually adopt simple pooling operations (eg. sum, average, max) when aggregating messages from a local neighborhood for updating node representation or pooling node representations from the entire graph to compute the graph representation. Though simple and effective, these linear operations do not model high-order non-linear interactions among nodes. We propose the Tensorized Graph Neural Network (tGNN), a highly expressive GNN architecture relying on tensor decomposition to model high-order non-linear node interactions. tGNN leverages the symmetric CP decomposition to efficiently parameterize permutation-invariant multilinear maps for modeling node interactions. Theoretical and empirical analysis on both node and graph classification tasks show the superiority of tGNN over competitive baselines. In particular, tGNN achieves the most solid results on two OGB node classification datasets and one OGB graph classification dataset.

📄 PDF Abstract BibTeX arXiv:2205.11691

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGraph ClassificationGraph Neural NetworkNode ClassificationTensor DecompositionVocal Bursts Intensity Prediction

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

High-order Tensor Pooling with Attention for Action Recognition

2021-10-11 · Lei Wang, Ke Sun, Piotr Koniusz

We aim at capturing high-order statistics of feature vectors formed by a neural network, and propose end-to-end second- and higher-order pooling to form a tensor descriptor. Tensor descriptors require a robust similarity…

Action RecognitionScene RecognitionVocal Bursts Intensity Prediction

Incidence Networks for Geometric Deep Learning

2019-05-27 · ICML 2020 1 · Marjan Albooyeh, Daniele Bertolini, Siamak Ravanbakhsh

Sparse incidence tensors can represent a variety of structured data. For example, we may represent attributed graphs using their node-node, node-edge, or edge-edge incidence matrices. In higher dimensions, incidence tens…

Deep LearningDrug DiscoveryMolecular Property PredictionRepresentation Learning

Efficient Contraction of Large Tensor Networks for Weighted Model Counting through Graph Decompositions

2019-08-12 · Jeffrey M. Dudek, Leonardo Dueñas-Osorio, Moshe Y. Vardi

Constrained counting is a fundamental problem in artificial intelligence. A promising new algebraic approach to constrained counting makes use of tensor networks, following a reduction from constrained counting to the pr…

Tensor Networks

Tensor Entropy for Uniform Hypergraphs

2019-12-20 · Can Chen, Indika Rajapakse

In this paper, we develop the notion of entropy for uniform hypergraphs via tensor theory. We employ the probability distribution of the generalized singular values, calculated from the higher-order singular value decomp…

Tensorizing GAN with High-Order Pooling for Alzheimer's Disease Assessment

2020-08-03 · Wen Yu, Baiying Lei, Michael K. Ng, Albert C. Cheung 외

It is of great significance to apply deep learning for the early diagnosis of Alzheimer's Disease (AD). In this work, a novel tensorizing GAN with high-order pooling is proposed to assess Mild Cognitive Impairment (MCI) …

Vocal Bursts Intensity Prediction