GETT-QA: Graph Embedding based T2T Transformer for Knowledge Graph Question Answering

2023-03-23 · Debayan Banerjee, Pranav Ajit Nair, Ricardo Usbeck, Chris Biemann

In this work, we present an end-to-end Knowledge Graph Question Answering (KGQA) system named GETT-QA. GETT-QA uses T5, a popular text-to-text pre-trained language model. The model takes a question in natural language as input and produces a simpler form of the intended SPARQL query. In the simpler form, the model does not directly produce entity and relation IDs. Instead, it produces corresponding entity and relation labels. The labels are grounded to KG entity and relation IDs in a subsequent step. To further improve the results, we instruct the model to produce a truncated version of the KG embedding for each entity. The truncated KG embedding enables a finer search for disambiguation purposes. We find that T5 is able to learn the truncated KG embeddings without any change of loss function, improving KGQA performance. As a result, we report strong results for LC-QuAD 2.0 and SimpleQuestions-Wikidata datasets on end-to-end KGQA over Wikidata.

📄 PDF Abstract BibTeX arXiv:2303.13284

Code (1)

debayan/gett-qa 공식 구현 pytorch

Tasks

Graph Embedding Graph Question Answering Knowledge Base Question AnsweringLanguage ModelingLanguage Modelling Question AnsweringRelation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Residual Connection 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Revisiting Catastrophic Forgetting in Continual Knowledge Graph Embedding

2026-04-21 · Gerard Pons, Carlos Escolano, Besim Bilalli, Anna Queralt arxiv

Knowledge Graph Embeddings (KGEs) support a wide range of downstream tasks over Knowledge Graphs (KGs). In practice, KGs evolve as new entities and facts are added, motivating Continual Knowledge Graph Embedding (CKGE) m…

Knowledge Graph Embedding Knowledge Graphs

Unlearning of Knowledge Graph Embedding via Preference Optimization

2025-07-28 · Jiajun Liu, Wenjun Ke, Peng Wang, Yao He 외 arxiv

Existing knowledge graphs (KGs) inevitably contain outdated or erroneous knowledge that needs to be removed from knowledge graph embedding (KGE) models. To address this challenge, knowledge unlearning can be applied to e…

Knowledge Graph Embedding Knowledge Graphs

Elastic Weight Consolidation for Knowledge Graph Continual Learning: An Empirical Evaluation

2025-12-01 · Gaganpreet Jhajj, Fuhua Lin arxiv

Knowledge graphs (KGs) require continual updates as new information emerges, but neural embedding models suffer from catastrophic forgetting when learning new tasks sequentially. We evaluate Elastic Weight Consolidation …

Continual Learning Knowledge Graphs Link Prediction

GraphKeeper: Graph Domain-Incremental Learning via Knowledge Disentanglement and Preservation

2025-10-30 · Zihao Guo, Qingyun Sun, Ziwei Zhang, Haonan Yuan 외 arxiv

Graph incremental learning (GIL), which continuously updates graph models by sequential knowledge acquisition, has garnered significant interest recently. However, existing GIL approaches focus on task-incremental and cl…

parameter-efficient fine-tuning Incremental Learning

Knowledge Relation Rank Enhanced Heterogeneous Learning Interaction Modeling for Neural Graph Forgetting Knowledge Tracing

2023-04-08 · Linqing Li, Zhifeng Wang

Recently, knowledge tracing models have been applied in educational data mining such as the Self-attention knowledge tracing model(SAKT), which models the relationship between exercises and Knowledge concepts(Kcs). Howev…

Knowledge Tracing Position Relation