paper-with-me

Papers

Invertible Neural Networks for Graph Prediction

2022-06-02 · Chen Xu, Xiuyuan Cheng, Yao Xie

Graph prediction problems prevail in data analysis and machine learning. The inverse prediction problem, namely to infer input data from given output labels, is of emerging interest in various applications. In this work, we develop \textit{invertible graph neural network} (iGNN), a deep generative model to tackle the inverse prediction problem on graphs by casting it as a conditional generative task. The proposed model consists of an invertible sub-network that maps one-to-one from data to an intermediate encoded feature, which allows forward prediction by a linear classification sub-network as well as efficient generation from output labels via a parametric mixture model. The invertibility of the encoding sub-network is ensured by a Wasserstein-2 regularization which allows free-form layers in the residual blocks. The model is scalable to large graphs by a factorized parametric mixture model of the encoded feature and is computationally scalable by using GNN layers. The existence of invertible flow mapping is backed by theories of optimal transport and diffusion process, and we prove the expressiveness of graph convolution layers to approximate the theoretical flows of graph data. The proposed iGNN model is experimentally examined on synthetic data, including the example on large graphs, and the empirical advantage is also demonstrated on real-application datasets of solar ramping event data and traffic flow anomaly detection.

📄 PDF Abstract BibTeX arXiv:2206.01163

Code (1)

hamrel-cxu/invertible-graph-neural-network-ignn 공식 구현 pytorch

Tasks

Anomaly DetectionGraph Neural NetworkPrediction

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

GraphNVP: an Invertible Flow-based Model for Generating Molecular Graphs

2019-09-25 · Kaushalya Madhawa, katsuhiko Ishiguro, Kosuke Nakago, Motoki Abe

We propose GraphNVP, an invertible flow-based molecular graph generation model. Existing flow-based models only handle node attributes of a graph with invertible maps. In contrast, our model is the first invertible model…

Graph GenerationMolecular Graph Generationvalid

Reversible Deep Learning for 13C NMR in Chemoinformatics: On Structures and Spectra

2026-02-01 · Stefan Kuhn, Vandana Dwarka, Przemyslaw Karol Grenda, Eero Vainikko arxiv

We introduce a reversible deep learning model for 13C NMR that uses a single conditional invertible neural network for both directions between molecular structures and spectra. The network is built from i-RevNet style bi…

Graph Residual Flow for Molecular Graph Generation

2019-09-30 · Shion Honda, Hirotaka Akita, katsuhiko Ishiguro, Toshiki Nakanishi 외

Statistical generative models for molecular graphs attract attention from many researchers from the fields of bio- and chemo-informatics. Among these models, invertible flow-based approaches are not fully explored yet. I…

Graph GenerationMolecular Graph Generation

Invertible Learned Primal-Dual

2021-10-19 · NeurIPS Workshop Deep_Invers 2021 12 · Jevgenija Rudzusika, Buda Bajic, Ozan Öktem, Carola-Bibiane Schönlieb 외

We propose invertible Learned Primal-Dual as a method for tomographic image reconstruction. This is a learned iterative method based on the Learned Primal-Dual neural network architecture, which incorporates ideas from i…

GPUImage Reconstruction

Invertible Attention

2021-06-16 · Jiajun Zha, Yiran Zhong, Jing Zhang, Richard Hartley 외

Attention has been proved to be an efficient mechanism to capture long-range dependencies. However, so far it has not been deployed in invertible networks. This is due to the fact that in order to make a network invertib…

Image Reconstruction