paper-with-me

홈 › Papers

Autoregressive Models for Knowledge Graph Generation

2026-02-06 · Thiviyan Thanapalasingam, Antonis Vozikis, Peter Bloem, Paul Groth arxiv

Knowledge Graph (KG) generation requires models to learn complex semantic dependencies between triples while maintaining domain validity constraints. Unlike link prediction, which scores triples independently, generative models must capture interdependencies across entire subgraphs to produce semantically coherent structures. We present ARK (Auto-Regressive Knowledge Graph Generation), a family of autoregressive models that generate KGs by treating graphs as sequences of (head, relation, tail) triples. ARK learns implicit semantic constraints directly from data, including type consistency, temporal validity, and relational patterns, without explicit rule supervision. On the IntelliGraphs benchmark, our models achieve 89.2% to 100.0% semantic validity across diverse datasets while generating novel graphs not seen during training. We also introduce SAIL, a variational extension of ARK that enables controlled generation through learned latent representations, supporting both unconditional sampling and conditional completion from partial graphs. Our analysis reveals that model capacity (hidden dimensionality >= 64) is more critical than architectural depth for KG generation, with recurrent architectures achieving comparable validity to transformer-based alternatives while offering substantial computational efficiency. These results demonstrate that autoregressive models provide an effective framework for KG generation, with practical applications in knowledge base completion and query answering.

📄 PDF Abstract BibTeX arXiv:2602.06707

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyGraph GenerationLink Prediction

Similar Papers 제목 키워드 기반

GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generation

2020-01-26 · ICLR 2020 1 · Chence Shi, Minkai Xu, Zhaocheng Zhu, Wei-Nan Zhang 외

Molecular graph generation is a fundamental problem for drug discovery and has been attracting growing attention. The problem is challenging since it requires not only generating chemically valid molecular structures but…

Density EstimationDrug DiscoveryGraph GenerationMolecular Graph Generation+2

Relational Memory Augmented Language Models

2022-01-24 · Qi Liu, Dani Yogatama, Phil Blunsom

We present a memory-augmented approach to condition an autoregressive language model on a knowledge graph. We represent the graph as a collection of relation triples and retrieve relevant relations for a given context to…

Language ModelingLanguage ModellingText Generation

KaLM: Knowledge-aligned Autoregressive Language Modeling via Dual-view Knowledge Graph Contrastive Learning

2024-12-06 · Peng Yu, Cheng Deng, Beiya Dai, Xinbing Wang 외

Autoregressive large language models (LLMs) pre-trained by next token prediction are inherently proficient in generative tasks. However, their performance on knowledge-driven tasks such as factual knowledge querying rema…

Contrastive LearningGraph Question AnsweringKnowledge Graph CompletionKnowledge Graphs+3

Towards Fast Graph Generation via Autoregressive Noisy Filtration Modeling

2025-02-04 · Markus Krimmel, Jenna Wiens, Karsten Borgwardt, Dexiong Chen

Graph generative models often face a critical trade-off between learning complex distributions and achieving fast generation speed. We introduce Autoregressive Noisy Filtration Modeling (ANFM), a novel approach that addr…

Graph GenerationTopological Data Analysis

SeaDAG: Semi-autoregressive Diffusion for Conditional Directed Acyclic Graph Generation

2024-10-21 · Xinyi Zhou, Xing Li, Yingzhao Lian, Yiwen Wang 외

We introduce SeaDAG, a semi-autoregressive diffusion model for conditional generation of Directed Acyclic Graphs (DAGs). Considering their inherent layer-wise structure, we simulate layer-wise autoregressive generation b…

DecoderDenoisingGraph Generation