paper-with-me

Papers

Aligning Knowledge Graphs Provided by Humans and Generated from Neural Networks in Specific Tasks

2024-04-23 · Tangrui Li, Jun Zhou

This paper develops an innovative method that enables neural networks to generate and utilize knowledge graphs, which describe their concept-level knowledge and optimize network parameters through alignment with human-provided knowledge. This research addresses a gap where traditionally, network-generated knowledge has been limited to applications in downstream symbolic analysis or enhancing network transparency. By integrating a novel autoencoder design with the Vector Symbolic Architecture (VSA), we have introduced auxiliary tasks that support end-to-end training. Our approach eschews traditional dependencies on ontologies or word embedding models, mining concepts from neural networks and directly aligning them with human knowledge. Experiments show that our method consistently captures network-generated concepts that align closely with human knowledge and can even uncover new, useful concepts not previously identified by humans. This plug-and-play strategy not only enhances the interpretability of neural networks but also facilitates the integration of symbolic logical reasoning within these systems.

📄 PDF Abstract BibTeX arXiv:2404.16884

Code (1)

moonwalker1997/vsannkgalignment 공식 구현 pytorch

Tasks

Knowledge GraphsLogical Reasoning

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Mutual Understanding between People and Systems via Neurosymbolic AI and Knowledge Graphs

2025-04-15 · Irene Celino, Mario Scrocca, Agnese Chiatti

This chapter investigates the concept of mutual understanding between humans and systems, positing that Neuro-symbolic Artificial Intelligence (NeSy AI) methods can significantly enhance this mutual understanding by leve…

Knowledge Graphs

Visual Graph Scaffolds for Structural Reasoning in Large Language Models

2026-06-01 · Runlin Lei, Xiaokui Xiao, Zhewei Wei arxiv

Graphs have been used to enhance large language models (LLMs) for structured reasoning, mostly as external knowledge sources are provided to models at test time. In this paper, we take a different view: the value of grap…

Multi-hop Question Answering

R2RML and RML Comparison for RDF Generation, their Rules Validation and Inconsistency Resolution

2020-05-13 · Anastasia Dimou

In this paper, an overview of the state of the art on knowledge graph generation is provided, with focus on the two prevalent mapping languages: the W3C recommended R2RML and its generalisation RML. We look into details …

Graph GenerationKnowledge Graphs

PRG: Prompt-Based Distillation Without Annotation via Proxy Relational Graph

2024-08-22 · Yijin Xu, Jialun Liu, HuaLiang Wei, Wenhui Li

In this paper, we propose a new distillation method for extracting knowledge from Large Foundation Models (LFM) into lightweight models, introducing a novel supervision mode that does not require manually annotated data.…

zero-shot-classificationZero-Shot Learning

Analysis of Gene Interaction Graphs as Prior Knowledge for Machine Learning Models

2019-05-06 · Paul Bertin, Mohammad Hashir, Martin Weiss, Vincent Frappier 외

Gene interaction graphs aim to capture various relationships between genes and can represent decades of biology research. When trying to make predictions from genomic data, those graphs could be used to overcome the curs…

BIG-bench Machine Learning