paper-with-me

Papers

Discrete Graph Auto-Encoder

2023-06-13 · Yoann Boget, Magda Gregorova, Alexandros Kalousis

Despite advances in generative methods, accurately modeling the distribution of graphs remains a challenging task primarily because of the absence of predefined or inherent unique graph representation. Two main strategies have emerged to tackle this issue: 1) restricting the number of possible representations by sorting the nodes, or 2) using permutation-invariant/equivariant functions, specifically Graph Neural Networks (GNNs). In this paper, we introduce a new framework named Discrete Graph Auto-Encoder (DGAE), which leverages the strengths of both strategies and mitigate their respective limitations. In essence, we propose a strategy in 2 steps. We first use a permutation-equivariant auto-encoder to convert graphs into sets of discrete latent node representations, each node being represented by a sequence of quantized vectors. In the second step, we sort the sets of discrete latent representations and learn their distribution with a specifically designed auto-regressive model based on the Transformer architecture. Through multiple experimental evaluations, we demonstrate the competitive performances of our model in comparison to the existing state-of-the-art across various datasets. Various ablation studies support the interest of our method.

📄 PDF Abstract BibTeX arXiv:2306.07735

Code (0)

등록된 구현이 없습니다.

Tasks

Graph GenerationQuantization

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

Masked Graph Autoencoder with Non-discrete Bandwidths

2024-02-06 · Ziwen Zhao, Yuhua Li, Yixiong Zou, Jiliang Tang 외

Masked graph autoencoders have emerged as a powerful graph self-supervised learning method that has yet to be fully explored. In this paper, we unveil that the existing discrete edge masking and binary link reconstructio…

BlockingLink PredictionNode ClassificationSelf-Supervised Learning

Graph Representation Learning with Diffusion Generative Models

2025-01-22 · Daniel Wesego

Diffusion models have established themselves as state-of-the-art generative models across various data modalities, including images and videos, due to their ability to accurately approximate complex data distributions. U…

DenoisingGraph Representation LearningRepresentation Learning

GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders

2018-02-09 · ICLR 2018 1 · Martin Simonovsky, Nikos Komodakis

Deep learning on graphs has become a popular research topic with many applications. However, past work has concentrated on learning graph embedding tasks, which is in contrast with advances in generative models for image…

DecoderGraph Embedding

Discrete Variational Autoencoding via Policy Search

2025-09-29 · Michael Drolet, Firas Al-Hafez, Aditya Bhatt, Jan Peters 외 arxiv

Discrete latent bottlenecks in variational autoencoders (VAEs) offer high bit efficiency and can be modeled with autoregressive discrete distributions, enabling parameter-efficient multimodal search with transformers. Ho…

Image Reconstruction

Graph Counterfactual Explainable AI via Latent Space Traversal

2025-01-15 · Andreas Abildtrup Hansen, Paraskevas Pegios, Anna Calissano, Aasa Feragen

Explaining the predictions of a deep neural network is a nontrivial task, yet high-quality explanations for predictions are often a prerequisite for practitioners to trust these models. Counterfactual explanations aim to…

counterfactual