LLMExplainer: Large Language Model based Bayesian Inference for Graph Explanation Generation
Recent studies seek to provide Graph Neural Network (GNN) interpretability via multiple unsupervised learning models. Due to the scarcity of datasets, current methods easily suffer from learning bias. To solve this problem, we embed a Large Language Model (LLM) as knowledge into the GNN explanation network to avoid the learning bias problem. We inject LLM as a Bayesian Inference (BI) module to mitigate learning bias. The efficacy of the BI module has been proven both theoretically and experimentally. We conduct experiments on both synthetic and real-world datasets. The innovation of our work lies in two parts: 1. We provide a novel view of the possibility of an LLM functioning as a Bayesian inference to improve the performance of existing algorithms; 2. We are the first to discuss the learning bias issues in the GNN explanation problem.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceExplanation GenerationGraph Neural NetworkLanguage ModelingLanguage ModellingLarge Language ModelMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Explaining Fine Tuned LLMs via Counterfactuals A Knowledge Graph Driven Framework
The widespread adoption of Low-Rank Adaptation (LoRA) has enabled large language models (LLMs) to acquire domain-specific knowledge with remarkable efficiency. However, understanding how such a fine-tuning mechanism alte…
Knowledge GraphsHeron Inference for Bayesian Graphical Models
Bayesian graphical models have been shown to be a powerful tool for discovering uncertainty and causal structure from real-world data in many application fields. Current inference methods primarily follow different kinds…
Computational EfficiencyVariational InferenceLLM-BI: Towards Fully Automated Bayesian Inference with Large Language Models
A significant barrier to the widespread adoption of Bayesian inference is the specification of prior distributions and likelihoods, which often requires specialized statistical expertise. This paper investigates the feas…
Bayesian InferenceVerbalized Probabilistic Graphical Modeling with Large Language Models
Faced with complex problems, the human brain demonstrates a remarkable capacity to transcend sensory input and form latent understandings of perceived world patterns. However, this cognitive capacity is not explicitly co…
Bayesian InferenceText GenerationEfficient Attack Graph Analysis through Approximate Inference
Attack graphs provide compact representations of the attack paths that an attacker can follow to compromise network resources by analysing network vulnerabilities and topology. These representations are a powerful tool f…
Bayesian InferenceClustering