paper-with-me

홈 › Papers

Verbalized Graph Representation Learning: A Fully Interpretable Graph Model Based on Large Language Models Throughout the Entire Process

2024-10-02 · Xingyu Ji, Jiale Liu, Lu Li, Maojun Wang, Zeyu Zhang

Representation learning on text-attributed graphs (TAGs) has attracted significant interest due to its wide-ranging real-world applications, particularly through Graph Neural Networks (GNNs). Traditional GNN methods focus on encoding the structural information of graphs, often using shallow text embeddings for node or edge attributes. This limits the model to understand the rich semantic information in the data and its reasoning ability for complex downstream tasks, while also lacking interpretability. With the rise of large language models (LLMs), an increasing number of studies are combining them with GNNs for graph representation learning and downstream tasks. While these approaches effectively leverage the rich semantic information in TAGs datasets, their main drawback is that they are only partially interpretable, which limits their application in critical fields. In this paper, we propose a verbalized graph representation learning (VGRL) method which is fully interpretable. In contrast to traditional graph machine learning models, which are usually optimized within a continuous parameter space, VGRL constrains this parameter space to be text description which ensures complete interpretability throughout the entire process, making it easier for users to understand and trust the decisions of the model. We conduct several studies to empirically evaluate the effectiveness of VGRL and we believe these method can serve as a stepping stone in graph representation learning.

📄 PDF Abstract BibTeX arXiv:2410.01457

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Representation LearningRepresentation Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Verbalized Representation Learning for Interpretable Few-Shot Generalization

2024-11-27 · Cheng-Fu Yang, Da Yin, WenBo Hu, Nanyun Peng 외

Humans recognize objects after observing only a few examples, a remarkable capability enabled by their inherent language understanding of the real-world environment. Developing verbalized and interpretable representation…

Language ModelingLanguage ModellingObject RecognitionRepresentation Learning

An Answer Verbalization Dataset for Conversational Question Answerings over Knowledge Graphs

2022-08-13 · Endri Kacupaj, Kuldeep Singh, Maria Maleshkova, Jens Lehmann

We introduce a new dataset for conversational question answering over Knowledge Graphs (KGs) with verbalized answers. Question answering over KGs is currently focused on answer generation for single-turn questions (KGQA)…

Answer GenerationConversational Question AnsweringKnowledge GraphsQuestion Answering

GraphGUIDE: interpretable and controllable conditional graph generation with discrete Bernoulli diffusion

2023-02-07 · Alex M. Tseng, Nathaniel Diamant, Tommaso Biancalani, Gabriele Scalia

Diffusion models achieve state-of-the-art performance in generating realistic objects and have been successfully applied to images, text, and videos. Recent work has shown that diffusion can also be defined on graphs, in…

Graph Generation

Verbalizing LLMs' assumptions to explain and control sycophancy

2026-04-03 · Myra Cheng, Isabel Sieh, Humishka Zope, Sunny Yu 외 arxiv

LLMs can be socially sycophantic, affirming users when they ask questions like "am I in the wrong?" rather than providing genuine assessment. We hypothesize that this behavior arises from incorrect assumptions about the …

Building a Knowledge Graph from Natural Language Definitions for Interpretable Text Entailment Recognition

2018-06-20 · LREC 2018 5 · Vivian S. Silva, André Freitas, Siegfried Handschuh

Natural language definitions of terms can serve as a rich source of knowledge, but structuring them into a comprehensible semantic model is essential to enable them to be used in semantic interpretation tasks. We propose…

World Knowledge