paper-with-me

Papers

Permute Me Softly: Learning Soft Permutations for Graph Representations

2021-10-05 · Giannis Nikolentzos, George Dasoulas, Michalis Vazirgiannis

Graph neural networks (GNNs) have recently emerged as a dominant paradigm for machine learning with graphs. Research on GNNs has mainly focused on the family of message passing neural networks (MPNNs). Similar to the Weisfeiler-Leman (WL) test of isomorphism, these models follow an iterative neighborhood aggregation procedure to update vertex representations, and they next compute graph representations by aggregating the representations of the vertices. Although very successful, MPNNs have been studied intensively in the past few years. Thus, there is a need for novel architectures which will allow research in the field to break away from MPNNs. In this paper, we propose a new graph neural network model, so-called $\pi$-GNN which learns a "soft" permutation (i.e., doubly stochastic) matrix for each graph, and thus projects all graphs into a common vector space. The learned matrices impose a "soft" ordering on the vertices of the input graphs, and based on this ordering, the adjacency matrices are mapped into vectors. These vectors can be fed into fully-connected or convolutional layers to deal with supervised learning tasks. In case of large graphs, to make the model more efficient in terms of running time and memory, we further relax the doubly stochastic matrices to row stochastic matrices. We empirically evaluate the model on graph classification and graph regression datasets and show that it achieves performance competitive with state-of-the-art models.

📄 PDF Abstract BibTeX arXiv:2110.01872

Code (1)

giannisnik/pi-GNN 공식 구현 pytorch

Tasks

Graph ClassificationGraph Neural NetworkGraph Regression

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음
Test 설명 없음

Similar Papers 제목 키워드 기반

Learning Representations of Sets through Optimized Permutations

2018-12-10 · ICLR 2019 5 · Yan Zhang, Jonathon Hare, Adam Prügel-Bennett

Representations of sets are challenging to learn because operations on sets should be permutation-invariant. To this end, we propose a Permutation-Optimisation module that learns how to permute a set end-to-end. The perm…

General ClassificationQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Multi-Subspace Matrix Recovery from Permuted Data

2024-12-17 · Liangqi Xie, Jicong Fan

This paper aims to recover a multi-subspace matrix from permuted data: given a matrix, in which the columns are drawn from a union of low-dimensional subspaces and some columns are corrupted by permutations on their entr…

Unlabeled Principal Component Analysis and Matrix Completion

2021-01-23 · NeurIPS 2021 12 · Yunzhen Yao, Liangzu Peng, Manolis C. Tsakiris

We introduce robust principal component analysis from a data matrix in which the entries of its columns have been corrupted by permutations, termed Unlabeled Principal Component Analysis (UPCA). Using algebraic geometry,…

Matrix Completion

A Unified Analysis of Stochastic Gradient Descent with Arbitrary Data Permutations and Beyond

2025-01-27 · Yipeng Li, Xinchen Lyu, Zhenyu Liu

We aim to provide a unified convergence analysis for permutation-based Stochastic Gradient Descent (SGD), where data examples are permuted before each epoch. By examining the relations among permutations, we categorize e…

Federated Learning

Online Learning with Local Permutations and Delayed Feedback

2017-03-13 · ICML 2017 8 · Ohad Shamir, Liran Szlak

We propose an Online Learning with Local Permutations (OLLP) setting, in which the learner is allowed to slightly permute the \emph{order} of the loss functions generated by an adversary. On one hand, this models natural…