Aligning Knowledge Graphs Provided by Humans and Generated from Neural Networks in Specific Tasks
This paper develops an innovative method that enables neural networks to generate and utilize knowledge graphs, which describe their concept-level knowledge and optimize network parameters through alignment with human-provided knowledge. This research addresses a gap where traditionally, network-generated knowledge has been limited to applications in downstream symbolic analysis or enhancing network transparency. By integrating a novel autoencoder design with the Vector Symbolic Architecture (VSA), we have introduced auxiliary tasks that support end-to-end training. Our approach eschews traditional dependencies on ontologies or word embedding models, mining concepts from neural networks and directly aligning them with human knowledge. Experiments show that our method consistently captures network-generated concepts that align closely with human knowledge and can even uncover new, useful concepts not previously identified by humans. This plug-and-play strategy not only enhances the interpretability of neural networks but also facilitates the integration of symbolic logical reasoning within these systems.
Code (1)
Tasks
Knowledge GraphsLogical ReasoningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Mutual Understanding between People and Systems via Neurosymbolic AI and Knowledge Graphs
This chapter investigates the concept of mutual understanding between humans and systems, positing that Neuro-symbolic Artificial Intelligence (NeSy AI) methods can significantly enhance this mutual understanding by leve…
Knowledge GraphsVisual Graph Scaffolds for Structural Reasoning in Large Language Models
Graphs have been used to enhance large language models (LLMs) for structured reasoning, mostly as external knowledge sources are provided to models at test time. In this paper, we take a different view: the value of grap…
Multi-hop Question AnsweringR2RML and RML Comparison for RDF Generation, their Rules Validation and Inconsistency Resolution
In this paper, an overview of the state of the art on knowledge graph generation is provided, with focus on the two prevalent mapping languages: the W3C recommended R2RML and its generalisation RML. We look into details …
Graph GenerationKnowledge GraphsPRG: Prompt-Based Distillation Without Annotation via Proxy Relational Graph
In this paper, we propose a new distillation method for extracting knowledge from Large Foundation Models (LFM) into lightweight models, introducing a novel supervision mode that does not require manually annotated data.…
zero-shot-classificationZero-Shot LearningAnalysis of Gene Interaction Graphs as Prior Knowledge for Machine Learning Models
Gene interaction graphs aim to capture various relationships between genes and can represent decades of biology research. When trying to make predictions from genomic data, those graphs could be used to overcome the curs…
BIG-bench Machine Learning