Using Large Language Models for Zero-Shot Natural Language Generation from Knowledge Graphs
In any system that uses structured knowledge graph (KG) data as its underlying knowledge representation, KG-to-text generation is a useful tool for turning parts of the graph data into text that can be understood by humans. Recent work has shown that models that make use of pretraining on large amounts of text data can perform well on the KG-to-text task even with relatively small sets of training data on the specific graph-to-text task. In this paper, we build on this concept by using large language models to perform zero-shot generation based on nothing but the model's understanding of the triple structure from what it can read. We show that ChatGPT achieves near state-of-the-art performance on some measures of the WebNLG 2020 challenge, but falls behind on others. Additionally, we compare factual, counter-factual and fictional statements, and show that there is a significant connection between what the LLM already knows about the data it is parsing and the quality of the output text.
Code (1)
Tasks
KG-to-Text GenerationKnowledge GraphsText GenerationSimilar Papers 제목 키워드 기반
Finetuned Language Models Are Zero-Shot Learners
This paper explores a simple method for improving the zero-shot learning abilities of language models. We show that instruction tuning -- finetuning language models on a collection of tasks described via instructions -- …
ARCCommon Sense ReasoningCoreference ResolutionLanguage Modeling+8Cedille: A large autoregressive French language model
Scaling up the size and training of autoregressive language models has enabled novel ways of solving Natural Language Processing tasks using zero-shot and few-shot learning. While extreme-scale language models such as GP…
Few-Shot LearningLanguage ModelingLanguage Modellingmodel+1ViTL: Temporal Logic-Guided Zero-Shot Natural Language Navigation via Vision-Language Models
Enabling robots to follow natural language commands to complete zero-shot long-horizon tasks remains challenging. It requires extracting implicit temporal and logical constraints from natural language commands and execut…
Zero-Shot Fact Verification via Natural Logic and Large Language Models
The recent development of fact verification systems with natural logic has enhanced their explainability by aligning claims with evidence through set-theoretic operators, providing faithful justifications. Despite these …
Fact VerificationZero-shot GeneralizationA Recipe For Arbitrary Text Style Transfer with Large Language Models
In this paper, we leverage large language models (LMs) to perform zero-shot text style transfer. We present a prompting method that we call augmented zero-shot learning, which frames style transfer as a sentence rewritin…
SentenceSentence ReWritingStyle TransferText Style Transfer+1