Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models
Reasoning over temporal knowledge graphs (TKGs) is fundamental to improving the efficiency and reliability of intelligent decision-making systems and has become a key technological foundation for future artificial intelligence applications. Despite recent progress, existing TKG reasoning models typically rely on large parameter sizes and intensive computation, leading to high hardware costs and energy consumption. These constraints hinder their deployment on resource-constrained, low-power, and distributed platforms that require real-time inference. Moreover, most existing model compression and distillation techniques are designed for static knowledge graphs and fail to adequately capture the temporal dependencies inherent in TKGs, often resulting in degraded reasoning performance. To address these challenges, we propose a distillation framework specifically tailored for temporal knowledge graph reasoning. Our approach leverages large language models as teacher models to guide the distillation process, enabling effective transfer of both structural and temporal reasoning capabilities to lightweight student models. By integrating large-scale public knowledge with task-specific temporal information, the proposed framework enhances the student model's ability to model temporal dynamics while maintaining a compact and efficient architecture. Extensive experiments on multiple publicly available benchmark datasets demonstrate that our method consistently outperforms strong baselines, achieving a favorable trade-off between reasoning accuracy, computational efficiency, and practical deployability.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyKnowledge DistillationModel CompressionKnowledge GraphsSimilar Papers 제목 키워드 기반
LLM-Guided Knowledge Distillation for Temporal Knowledge Graph Reasoning
Temporal knowledge graphs (TKGs) support reasoning over time-evolving facts, yet state-of-the-art models are often computationally heavy and costly to deploy. Existing compression and distillation techniques are largely …
Knowledge DistillationKnowledge GraphsLink PredictionMutually-paced Knowledge Distillation for Cross-lingual Temporal Knowledge Graph Reasoning
This paper investigates cross-lingual temporal knowledge graph reasoning problem, which aims to facilitate reasoning on Temporal Knowledge Graphs (TKGs) in low-resource languages by transfering knowledge from TKGs in hig…
Knowledge DistillationKnowledge GraphsTransfer LearningLearning to Reason: Temporal Saliency Distillation for Interpretable Knowledge Transfer
Knowledge distillation has proven effective for model compression by transferring knowledge from a larger network called the teacher to a smaller network called the student. Current knowledge distillation in time series …
Knowledge DistillationTime Series AnalysisModel CompressionEfficient Traffic Prediction Through Spatio-Temporal Distillation
Graph neural networks (GNNs) have gained considerable attention in recent years for traffic flow prediction due to their ability to learn spatio-temporal pattern representations through a graph-based message-passing fram…
Knowledge DistillationPredictionTraffic PredictionKnowledge Graph-Guided Multi-Agent Distillation for Reliable Industrial Question Answering with Datasets
Industrial question-answering (QA) systems require higher safety and reliability than general-purpose dialogue models, as errors in high-risk scenarios such as equipment fault diagnosis can have severe consequences. Alth…
Question AnsweringFault Diagnosis