paper-with-me

Papers

Self-Attention Graph Pooling

2019-04-17 · Junhyun Lee, Inyeop Lee, Jaewoo Kang

Advanced methods of applying deep learning to structured data such as graphs have been proposed in recent years. In particular, studies have focused on generalizing convolutional neural networks to graph data, which includes redefining the convolution and the downsampling (pooling) operations for graphs. The method of generalizing the convolution operation to graphs has been proven to improve performance and is widely used. However, the method of applying downsampling to graphs is still difficult to perform and has room for improvement. In this paper, we propose a graph pooling method based on self-attention. Self-attention using graph convolution allows our pooling method to consider both node features and graph topology. To ensure a fair comparison, the same training procedures and model architectures were used for the existing pooling methods and our method. The experimental results demonstrate that our method achieves superior graph classification performance on the benchmark datasets using a reasonable number of parameters.

📄 PDF Abstract BibTeX arXiv:1904.08082

Code (3)

inyeoplee77/SAGPool 공식 구현 pytorch
dmlc/dgl/tree/master/examples/pytorch/sagpool pytorch
walidgeuttala/Synthetic-Benchmark-for-Graph-Classification pytorch

Tasks

Graph Classification

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Multi-hop Attention-based Graph Pooling: A Personalized PageRank Perspective

2024-03-04 · International Conference on Distributed Computing and High Performance Computing (DCHPC) 2024 3 · Parsa Haddadian, Roya Booryaee, Rooholah Abedian, Ali Moeini

Over the past ten years, graph representation learning has garnered a lot of attention due to the variety of graph-structured data and its efficiency in both time and space. One essential method for obtaining effective g…

Graph ClassificationGraph Representation LearningRepresentation Learning

Structure Representation Learning by Jointly Learning to Pool and Represent

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Structure representation learning is a task to provide an overall representation for a given structure (e.g., sequential text, non-sequential graph). This representation characterizes the property of that structure. Prev…

ClassificationGraph ClassificationRepresentation LearningSentence+1

Graph Pooling via Coarsened Graph Infomax

2021-05-04 · Yunsheng Pang, Yunxiang Zhao, Dongsheng Li

Graph pooling that summaries the information in a large graph into a compact form is essential in hierarchical graph representation learning. Existing graph pooling methods either suffer from high computational complexit…

Contrastive LearningGraph Representation LearningRepresentation Learning

DAGCN: Dual Attention Graph Convolutional Networks

2019-04-04 · Fengwen Chen, Shirui Pan, Jing Jiang, Huan Huo 외

Graph convolutional networks (GCNs) have recently become one of the most powerful tools for graph analytics tasks in numerous applications, ranging from social networks and natural language processing to bioinformatics a…

General ClassificationGraph ClassificationGraph Embedding

Text Information Aggregation with Centrality Attention

2020-11-16 · Jingjing Gong, Hang Yan, Yining Zheng, Xipeng Qiu 외

A lot of natural language processing problems need to encode the text sequence as a fix-length vector, which usually involves aggregation process of combining the representations of all the words, such as pooling or self…

Sentencetext-classificationText Classification