paper-with-me

Papers

Modern Baselines for SPARQL Semantic Parsing

2022-04-27 · Debayan Banerjee, Pranav Ajit Nair, Jivat Neet Kaur, Ricardo Usbeck, Chris Biemann

In this work, we focus on the task of generating SPARQL queries from natural language questions, which can then be executed on Knowledge Graphs (KGs). We assume that gold entity and relations have been provided, and the remaining task is to arrange them in the right order along with SPARQL vocabulary, and input tokens to produce the correct SPARQL query. Pre-trained Language Models (PLMs) have not been explored in depth on this task so far, so we experiment with BART, T5 and PGNs (Pointer Generator Networks) with BERT embeddings, looking for new baselines in the PLM era for this task, on DBpedia and Wikidata KGs. We show that T5 requires special input tokenisation, but produces state of the art performance on LC-QuAD 1.0 and LC-QuAD 2.0 datasets, and outperforms task-specific models from previous works. Moreover, the methods enable semantic parsing for questions where a part of the input needs to be copied to the output query, thus enabling a new paradigm in KG semantic parsing.

📄 PDF Abstract BibTeX arXiv:2204.12793

Code (1)

debayan/sigir2022-sparqlbaselines 공식 구현 pytorch

Tasks

Knowledge GraphsSemantic Parsing

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
WordPiece 설명 없음
Weight Decay 설명 없음
SentencePiece 설명 없음
Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Adafactor Adafactor is a stochastic optimization method based on Adam that reduces memory usage while retaining the empirical benefits of…

Similar Papers 제목 키워드 기반

Semantic Parsing Natural Language into SPARQL: Improving Target Language Representation with Neural Attention

2018-03-12 · Fabiano Ferreira Luz, Marcelo Finger

Semantic parsing is the process of mapping a natural language sentence into a formal representation of its meaning. In this work we use the neural network approach to transform natural language sentence into a query to a…

Semantic ParsingSentence

The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing

2023-05-24 · Debayan Banerjee, Pranav Ajit Nair, Ricardo Usbeck, Chris Biemann

In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing. We perform experiments within the the context of knowledge graph question answering (KGQA), whe…

Graph Question AnsweringQuestion AnsweringSemantic Parsing

A Neural Approach to KGQA via SPARQL Silhouette Generation

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Semantic parsing is a predominant approach to solve the Knowledge Graph Question Answering (KGQA) task where, natural language question is translated into a logic form such as SPARQL. Semantic parsing based …

Graph Question AnsweringMachine TranslationNMTQuestion Answering+3

Enhancing SPARQL Generation by Triplet-order-sensitive Pre-training

2024-10-08 · Chang Su, Jiexing Qi, He Yan, Kai Zou 외

Semantic parsing that translates natural language queries to SPARQL is of great importance for Knowledge Graph Question Answering (KGQA) systems. Although pre-trained language models like T5 have achieved significant suc…

Graph Question AnsweringLanguage ModelingLanguage ModellingMasked Language Modeling+5

Learning to Transpile AMR into SPARQL

2021-12-15 · Mihaela Bornea, Ramon Fernandez Astudillo, Tahira Naseem, Nandana Mihindukulasooriya 외

We propose a transition-based system to transpile Abstract Meaning Representation (AMR) into SPARQL for Knowledge Base Question Answering (KBQA). This allows us to delegate part of the semantic representation to a strong…

Abstract Meaning RepresentationKnowledge Base Question AnsweringQuestion AnsweringSemantic Parsing