Knowledge Graph Completion Models are Few-shot Learners: An Empirical Study of Relation Labeling in E-commerce with LLMs
Knowledge Graphs (KGs) play a crucial role in enhancing e-commerce system performance by providing structured information about entities and their relationships, such as complementary or substitutable relations between products or product types, which can be utilized in recommender systems. However, relation labeling in KGs remains a challenging task due to the dynamic nature of e-commerce domains and the associated cost of human labor. Recently, breakthroughs in Large Language Models (LLMs) have shown surprising results in numerous natural language processing tasks. In this paper, we conduct an empirical study of LLMs for relation labeling in e-commerce KGs, investigating their powerful learning capabilities in natural language and effectiveness in predicting relations between product types with limited labeled data. We evaluate various LLMs, including PaLM and GPT-3.5, on benchmark datasets, demonstrating their ability to achieve competitive performance compared to humans on relation labeling tasks using just 1 to 5 labeled examples per relation. Additionally, we experiment with different prompt engineering techniques to examine their impact on model performance. Our results show that LLMs significantly outperform existing KG completion models in relation labeling for e-commerce KGs and exhibit performance strong enough to replace human labeling.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge Graph CompletionKnowledge GraphsPrompt EngineeringRecommendation SystemsRelationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Few-Shot Knowledge Graph Completion with Data Fusion and Augmentation
This paper addresses the few-shot knowledge graph completion problem, which aims to infer facts for long-tail distributed relations for completing knowledge graphs. The few-shot knowledge graph completion task confronts …
Few-Shot LearningKnowledge Graph CompletionKnowledge GraphsWorld KnowledgeGraph Stochastic Neural Process for Inductive Few-shot Knowledge Graph Completion
Knowledge graphs (KGs) store enormous facts as relationships between entities. Due to the long-tailed distribution of relations and the incompleteness of KGs, there is growing interest in few-shot knowledge graph complet…
Knowledge Graph CompletionKnowledge GraphsChallenging the Assumption of Structure-based embeddings in Few- and Zero-shot Knowledge Graph Completion
In this paper, we report experiments on Few- and Zero-shot Knowledge Graph completion, where the objective is to add missing relational links between entities into an existing Knowledge Graph with few or no previous exam…
DescriptiveKnowledge Graph CompletionTransfer LearningFew-Shot Knowledge Graph Completion
Knowledge graphs (KGs) serve as useful resources for various natural language processing applications. Previous KG completion approaches require a large number of training instances (i.e., head-tail entity pairs) for eve…
Knowledge Graph CompletionKnowledge GraphsOne-Shot LearningRelationTRIX: A More Expressive Model for Zero-shot Domain Transfer in Knowledge Graphs
Fully inductive knowledge graph models can be trained on multiple domains and subsequently perform zero-shot knowledge graph completion (KGC) in new unseen domains. This is an important capability towards the goal of hav…
Knowledge Graph CompletionKnowledge GraphsRelationRelation Prediction+1