A Hierarchical Language Model For Interpretable Graph Reasoning

2024-10-29 · Sambhav Khurana, Xiner Li, Shurui Gui, Shuiwang Ji

Large language models (LLMs) are being increasingly explored for graph tasks. Despite their remarkable success in text-based tasks, LLMs' capabilities in understanding explicit graph structures remain limited, particularly with large graphs. In this work, we introduce Hierarchical Language Model for Graph (HLM-G), which employs a two-block architecture to capture node-centric local information and interaction-centric global structure, effectively enhancing graph structure understanding abilities. The proposed scheme allows LLMs to address various graph queries with high efficacy, efficiency, and robustness, while reducing computational costs on large-scale graph tasks. Furthermore, we demonstrate the interpretability of our model using intrinsic attention weights and established explainers. Comprehensive evaluations across diverse graph reasoning and real-world tasks of node, link, and graph-levels highlight the superiority of our method, marking a significant advancement in the application of LLMs to graph understanding.

📄 PDF Abstract BibTeX arXiv:2410.22372

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modellingmodel

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

ENTER: Event Based Interpretable Reasoning for VideoQA

2025-01-24 · Hammad Ayyubi, Junzhang Liu, Ali Asgarov, Zaber Ibn Abdul Hakim 외

In this paper, we present ENTER, an interpretable Video Question Answering (VideoQA) system based on event graphs. Event graphs convert videos into graphical representations, where video events form the nodes and event-e…

Code Generation EgoSchema Question Answering Video Question Answering+1

Probabilistic Concept Graph Reasoning for Multimodal Misinformation Detection

2026-03-26 · Ruichao Yang, Wei Gao, Xiaobin Zhu, Jing Ma 외 arxiv

Multimodal misinformation poses an escalating challenge that often evades traditional detectors, which are opaque black boxes and fragile against new manipulation tactics. We present Probabilistic Concept Graph Reasoning…

Deep Reinforcement Learning with Stacked Hierarchical Attention for Text-based Games

2020-10-22 · NeurIPS 2020 12 · Yunqiu Xu, Meng Fang, Ling Chen, Yali Du 외

We study reinforcement learning (RL) for text-based games, which are interactive simulations in the context of natural language. While different methods have been developed to represent the environment information and la…

Decision Making Deep Reinforcement Learning Knowledge Graphs reinforcement-learning+2

MLLM-HWSI: A Multimodal Large Language Model for Hierarchical Whole Slide Image Understanding

2026-03-24 · Basit Alawode, Arif Mahmood, Muaz Khalifa Al-Radi, Shahad Albastaki 외 arxiv

Whole Slide Images (WSIs) exhibit hierarchical structure, where diagnostic information emerges from cellular morphology, regional tissue organization, and global context. Existing Computational Pathology (CPath) Multimod…

Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach

2026-01-01 · Biao Wu, Meng Fang, Ling Chen, Ke Xu 외 arxiv

Recent advances in vision-language models have opened up new possibilities for reasoning-driven image geolocalization. However, existing approaches often rely on synthetic reasoning annotations or external image retrieva…

Reinforcement Learning Image Retrieval