paper-with-me

Papers

Normalizing Flow-based Neural Process for Few-Shot Knowledge Graph Completion

2023-04-17 · Linhao Luo, Yuan-Fang Li, Gholamreza Haffari, Shirui Pan

Knowledge graphs (KGs), as a structured form of knowledge representation, have been widely applied in the real world. Recently, few-shot knowledge graph completion (FKGC), which aims to predict missing facts for unseen relations with few-shot associated facts, has attracted increasing attention from practitioners and researchers. However, existing FKGC methods are based on metric learning or meta-learning, which often suffer from the out-of-distribution and overfitting problems. Meanwhile, they are incompetent at estimating uncertainties in predictions, which is critically important as model predictions could be very unreliable in few-shot settings. Furthermore, most of them cannot handle complex relations and ignore path information in KGs, which largely limits their performance. In this paper, we propose a normalizing flow-based neural process for few-shot knowledge graph completion (NP-FKGC). Specifically, we unify normalizing flows and neural processes to model a complex distribution of KG completion functions. This offers a novel way to predict facts for few-shot relations while estimating the uncertainty. Then, we propose a stochastic ManifoldE decoder to incorporate the neural process and handle complex relations in few-shot settings. To further improve performance, we introduce an attentive relation path-based graph neural network to capture path information in KGs. Extensive experiments on three public datasets demonstrate that our method significantly outperforms the existing FKGC methods and achieves state-of-the-art performance. Code is available at https://github.com/RManLuo/NP-FKGC.git.

📄 PDF Abstract BibTeX arXiv:2304.08183

Code (1)

rmanluo/np-fkgc 공식 구현 pytorch

Tasks

Graph Neural NetworkKnowledge Graph CompletionKnowledge GraphsMeta-LearningMetric Learning

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음
Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Categorical Normalizing Flows via Continuous Transformations

2020-06-17 · ICLR 2021 1 · Phillip Lippe, Efstratios Gavves

Despite their popularity, to date, the application of normalizing flows on categorical data stays limited. The current practice of using dequantization to map discrete data to a continuous space is inapplicable as catego…

DecoderInductive BiasVariational Inference

Graphical Normalizing Flows

2020-06-03 · Antoine Wehenkel, Gilles Louppe

Normalizing flows model complex probability distributions by combining a base distribution with a series of bijective neural networks. State-of-the-art architectures rely on coupling and autoregressive transformations to…

Density Estimation

Causal normalizing flows: from theory to practice

2023-06-08 · NeurIPS 2023 11 · Adrián Javaloy, Pablo Sánchez-Martín, Isabel Valera

In this work, we deepen on the use of normalizing flows for causal reasoning. Specifically, we first leverage recent results on non-linear ICA to show that causal models are identifiable from observational data given a c…

counterfactual

E(n) Equivariant Normalizing Flows

2021-05-19 · NeurIPS 2021 12 · Victor Garcia Satorras, Emiel Hoogeboom, Fabian B. Fuchs, Ingmar Posner 외

This paper introduces a generative model equivariant to Euclidean symmetries: E(n) Equivariant Normalizing Flows (E-NFs). To construct E-NFs, we take the discriminative E(n) graph neural networks and integrate them as a …

FANFOLD: Graph Normalizing Flows-driven Asymmetric Network for Unsupervised Graph-Level Anomaly Detection

2024-06-29 · Rui Cao, Shijie Xue, Jindong Li, Qi Wang 외

Unsupervised graph-level anomaly detection (UGAD) has attracted increasing interest due to its widespread application. In recent studies, knowledge distillation-based methods have been widely used in unsupervised anomaly…

Anomaly DetectionKnowledge DistillationUnsupervised Anomaly Detection