paper-with-me

홈 › Papers

Permutation Invariant Representations with Applications to Graph Deep Learning

2022-03-14 · Radu Balan, Naveed Haghani, Maneesh Singh

This paper presents primarily two Euclidean embeddings of the quotient space generated by matrices that are identified modulo arbitrary row permutations. The original application is in deep learning on graphs where the learning task is invariant to node relabeling. Two embedding schemes are introduced, one based on sorting and the other based on algebras of multivariate polynomials. While both embeddings exhibit a computational complexity exponential in problem size, the sorting based embedding is globally bi-Lipschitz and admits a low dimensional target space. Additionally, an almost everywhere injective scheme can be implemented with minimal redundancy and low computational cost. In turn, this proves that almost any classifier can be implemented with an arbitrary small loss of performance. Numerical experiments are carried out on two data sets, a chemical compound data set (QM9) and a proteins data set (PROTEINS).

📄 PDF Abstract BibTeX arXiv:2203.07546

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

Permutation Invariant Gaussian Matrix Models

2018-09-20 · Sanjaye Ramgoolam

Permutation invariant Gaussian matrix models were recently developed for applications in computational linguistics. A 5-parameter family of models was solved. In this paper, we use a representation theoretic approach to …

Graph Embedding VAE: A Permutation Invariant Model of Graph Structure

2019-10-17 · Tony Duan, Juho Lee

Generative models of graph structure have applications in biology and social sciences. The state of the art is GraphRNN, which decomposes the graph generation process into a series of sequential steps. While effective fo…

Graph EmbeddingGraph Generation

Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learning

2023-02-24 · Ryan Kortvelesy, Steven Morad, Amanda Prorok

The problem of permutation-invariant learning over set representations is particularly relevant in the field of multi-agent systems -- a few potential applications include unsupervised training of aggregation functions i…

Permutation-Invariant Variational Autoencoder for Graph-Level Representation Learning

2021-04-20 · NeurIPS 2021 12 · Robin Winter, Frank Noé, Djork-Arné Clevert

Recently, there has been great success in applying deep neural networks on graph structured data. Most work, however, focuses on either node- or graph-level supervised learning, such as node, link or graph classification…

ClusteringGeneral ClassificationGraph ClassificationGraph Matching+3

Invariant embedding for graph classification

2019-08-18 · ICML 2019 8 · Alexis Galland, Marc Lelarge

Learning on graphs requires a graph feature representation able to discriminate among different graphs while being amenable to fast computation. The graph isomorphism problem tells us that fast representation of graphs i…

ClassificationGeneral ClassificationGraph ClassificationGraph Embedding