paper-with-me

홈 › Papers

AutoQGS: Auto-Prompt for Low-Resource Knowledge-based Question Generation from SPARQL

2022-08-26 · Guanming Xiong, Junwei Bao, Wen Zhao, Youzheng Wu, Xiaodong He

This study investigates the task of knowledge-based question generation (KBQG). Conventional KBQG works generated questions from fact triples in the knowledge graph, which could not express complex operations like aggregation and comparison in SPARQL. Moreover, due to the costly annotation of large-scale SPARQL-question pairs, KBQG from SPARQL under low-resource scenarios urgently needs to be explored. Recently, since the generative pre-trained language models (PLMs) typically trained in natural language (NL)-to-NL paradigm have been proven effective for low-resource generation, e.g., T5 and BART, how to effectively utilize them to generate NL-question from non-NL SPARQL is challenging. To address these challenges, AutoQGS, an auto-prompt approach for low-resource KBQG from SPARQL, is proposed. Firstly, we put forward to generate questions directly from SPARQL for the KBQG task to handle complex operations. Secondly, we propose an auto-prompter trained on large-scale unsupervised data to rephrase SPARQL into NL description, smoothing the low-resource transformation from non-NL SPARQL to NL question with PLMs. Experimental results on the WebQuestionsSP, ComlexWebQuestions 1.1, and PathQuestions show that our model achieves state-of-the-art performance, especially in low-resource settings. Furthermore, a corpus of 330k factoid complex question-SPARQL pairs is generated for further KBQG research.

📄 PDF Abstract BibTeX arXiv:2208.12461

Code (1)

jimxionggm/autoqgs 공식 구현 pytorch

Tasks

Question GenerationQuestion-Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
SentencePiece 설명 없음
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…

Similar Papers 제목 키워드 기반

Few-shot Unified Question Answering: Tuning Models or Prompts?

2023-05-23 · Srijan Bansal, Semih Yavuz, Bo Pang, Meghana Bhat 외

Question-answering (QA) tasks often investigate specific question types, knowledge domains, or reasoning skills, leading to specialized models catering to specific categories of QA tasks. While recent research has explor…

Question AnsweringTransfer Learning

Native vs Non-Native Language Prompting: A Comparative Analysis

2024-09-11 · Mohamed Bayan Kmainasi, Rakif Khan, Ali Ezzat Shahroor, Boushra Bendou 외

Large language models (LLMs) have shown remarkable abilities in different fields, including standard Natural Language Processing (NLP) tasks. To elicit knowledge from LLMs, prompts play a key role, consisting of natural …

Ontology-Guided, Hybrid Prompt Learning for Generalization in Knowledge Graph Question Answering

2025-02-06 · Longquan Jiang, Junbo Huang, Cedric Möller, Ricardo Usbeck

Most existing Knowledge Graph Question Answering (KGQA) approaches are designed for a specific KG, such as Wikidata, DBpedia or Freebase. Due to the heterogeneity of the underlying graph schema, topology and assertions, …

Graph Question AnsweringKnowledge GraphsLarge Language ModelPrompt Learning+2

Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generation

2023-10-12 · Yuanyuan Liang, Jianing Wang, Hanlun Zhu, Lei Wang 외

The task of Question Generation over Knowledge Bases (KBQG) aims to convert a logical form into a natural language question. For the sake of expensive cost of large-scale question annotation, the methods of KBQG under lo…

In-Context LearningQuestion GenerationQuestion-Generation

Evaluating Prompt-based Question Answering for Object Prediction in the Open Research Knowledge Graph

2023-05-22 · Jennifer D'Souza, Moussab Hrou, Sören Auer

There have been many recent investigations into prompt-based training of transformer language models for new text genres in low-resource settings. The prompt-based training approach has been found to be effective in gene…

General KnowledgeQuestion AnsweringRelation Extraction