paper-with-me

홈 › Papers

Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models

2026-01-01 · Wang Xing, Wei Song, Siyu Lin, Chen Wu, Zhesi Li, Man Wang arxiv

Reasoning over temporal knowledge graphs (TKGs) is fundamental to improving the efficiency and reliability of intelligent decision-making systems and has become a key technological foundation for future artificial intelligence applications. Despite recent progress, existing TKG reasoning models typically rely on large parameter sizes and intensive computation, leading to high hardware costs and energy consumption. These constraints hinder their deployment on resource-constrained, low-power, and distributed platforms that require real-time inference. Moreover, most existing model compression and distillation techniques are designed for static knowledge graphs and fail to adequately capture the temporal dependencies inherent in TKGs, often resulting in degraded reasoning performance. To address these challenges, we propose a distillation framework specifically tailored for temporal knowledge graph reasoning. Our approach leverages large language models as teacher models to guide the distillation process, enabling effective transfer of both structural and temporal reasoning capabilities to lightweight student models. By integrating large-scale public knowledge with task-specific temporal information, the proposed framework enhances the student model's ability to model temporal dynamics while maintaining a compact and efficient architecture. Extensive experiments on multiple publicly available benchmark datasets demonstrate that our method consistently outperforms strong baselines, achieving a favorable trade-off between reasoning accuracy, computational efficiency, and practical deployability.

📄 PDF Abstract BibTeX arXiv:2601.00202

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyKnowledge DistillationModel CompressionKnowledge Graphs

Similar Papers 제목 키워드 기반

LLM-Guided Knowledge Distillation for Temporal Knowledge Graph Reasoning

2026-02-16 · Wang Xing, Wei Song, Siyu Lin, Chen Wu 외 arxiv

Temporal knowledge graphs (TKGs) support reasoning over time-evolving facts, yet state-of-the-art models are often computationally heavy and costly to deploy. Existing compression and distillation techniques are largely …

Knowledge DistillationKnowledge GraphsLink Prediction

Mutually-paced Knowledge Distillation for Cross-lingual Temporal Knowledge Graph Reasoning

2023-03-27 · Ruijie Wang, Zheng Li, Jingfeng Yang, Tianyu Cao 외

This paper investigates cross-lingual temporal knowledge graph reasoning problem, which aims to facilitate reasoning on Temporal Knowledge Graphs (TKGs) in low-resource languages by transfering knowledge from TKGs in hig…

Knowledge DistillationKnowledge GraphsTransfer Learning

Learning to Reason: Temporal Saliency Distillation for Interpretable Knowledge Transfer

2026-01-07 · Nilushika Udayangani Hewa Dehigahawattage, Kishor Nandakishor, Marimuthu Palaniswami arxiv

Knowledge distillation has proven effective for model compression by transferring knowledge from a larger network called the teacher to a smaller network called the student. Current knowledge distillation in time series …

Knowledge DistillationTime Series AnalysisModel Compression

Efficient Traffic Prediction Through Spatio-Temporal Distillation

2025-01-15 · Qianru Zhang, Xinyi Gao, Haixin Wang, Siu-Ming Yiu 외

Graph neural networks (GNNs) have gained considerable attention in recent years for traffic flow prediction due to their ability to learn spatio-temporal pattern representations through a graph-based message-passing fram…

Knowledge DistillationPredictionTraffic Prediction

Knowledge Graph-Guided Multi-Agent Distillation for Reliable Industrial Question Answering with Datasets

2025-10-03 · Jiqun Pan, Zhenke Duan, Jiani Tu, Anzhi Cheng 외 arxiv

Industrial question-answering (QA) systems require higher safety and reliability than general-purpose dialogue models, as errors in high-risk scenarios such as equipment fault diagnosis can have severe consequences. Alth…

Question AnsweringFault Diagnosis