paper-with-me

Papers

ETT-CKGE: Efficient Task-driven Tokens for Continual Knowledge Graph Embedding

2025-06-09 · Lijing Zhu, Qizhen Lan, Qing Tian, Wenbo Sun, Li Yang, Lu Xia, Yixin Xie, Xi Xiao, Tiehang Duan, Cui Tao, Shuteng Niu

Continual Knowledge Graph Embedding (CKGE) seeks to integrate new knowledge while preserving past information. However, existing methods struggle with efficiency and scalability due to two key limitations: (1) suboptimal knowledge preservation between snapshots caused by manually designed node/relation importance scores that ignore graph dependencies relevant to the downstream task, and (2) computationally expensive graph traversal for node/relation importance calculation, leading to slow training and high memory overhead. To address these limitations, we introduce ETT-CKGE (Efficient, Task-driven, Tokens for Continual Knowledge Graph Embedding), a novel task-guided CKGE method that leverages efficient task-driven tokens for efficient and effective knowledge transfer between snapshots. Our method introduces a set of learnable tokens that directly capture task-relevant signals, eliminating the need for explicit node scoring or traversal. These tokens serve as consistent and reusable guidance across snapshots, enabling efficient token-masked embedding alignment between snapshots. Importantly, knowledge transfer is achieved through simple matrix operations, significantly reducing training time and memory usage. Extensive experiments across six benchmark datasets demonstrate that ETT-CKGE consistently achieves superior or competitive predictive performance, while substantially improving training efficiency and scalability compared to state-of-the-art CKGE methods. The code is available at: https://github.com/lijingzhu1/ETT-CKGE/tree/main

📄 PDF Abstract BibTeX arXiv:2506.08158

Code (1)

lijingzhu1/ett-ckge 공식 구현 pytorch

Tasks

Graph EmbeddingKnowledge Graph EmbeddingTransfer Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Revisiting Catastrophic Forgetting in Continual Knowledge Graph Embedding

2026-04-21 · Gerard Pons, Carlos Escolano, Besim Bilalli, Anna Queralt arxiv

Knowledge Graph Embeddings (KGEs) support a wide range of downstream tasks over Knowledge Graphs (KGs). In practice, KGs evolve as new entities and facts are added, motivating Continual Knowledge Graph Embedding (CKGE) m…

Knowledge Graph EmbeddingKnowledge Graphs

SoTCKGE:Continual Knowledge Graph Embedding Based on Spatial Offset Transformation

2025-03-11 · Xinyan Wang, Jinshuo Liu, Cheng Bi, Kaijian Xie 외

Current Continual Knowledge Graph Embedding (CKGE) methods primarily rely on translation-based embedding methods, leveraging previously acquired knowledge to initialize new facts. To enhance learning efficiency, these me…

Continual LearningGraph EmbeddingKnowledge Graph EmbeddingTranslation

Learning to Evolve: Bayesian-Guided Continual Knowledge Graph Embedding

2025-08-04 · Linyu Li, Zhi Jin, Yuanpeng He, Dongming Jin 외 arxiv

As social media and the World Wide Web become hubs for information dissemination, effectively organizing and understanding the vast amounts of dynamically evolving Web content is crucial. Knowledge graphs (KGs) provide a…

Knowledge Graph EmbeddingContinual LearningBayesian InferenceKnowledge Graphs

SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph Embedding

2025-08-15 · Yifei Li, Lingling Zhang, Hang Yan, Tianzhe Zhao 외 arxiv

Traditional knowledge graph (KG) embedding methods aim to represent entities and relations in a low-dimensional space, primarily focusing on static graphs. However, real-world KGs are dynamically evolving with the consta…

Knowledge Graph Embedding

Towards Continual Knowledge Graph Embedding via Incremental Distillation

2024-05-07 · Jiajun Liu, Wenjun Ke, Peng Wang, Ziyu Shang 외

Traditional knowledge graph embedding (KGE) methods typically require preserving the entire knowledge graph (KG) with significant training costs when new knowledge emerges. To address this issue, the continual knowledge …

Graph EmbeddingKnowledge Graph Embedding