paper-with-me

홈 › Papers

Continual Multimodal Knowledge Graph Construction

2023-05-15 · Xiang Chen, Jintian Zhang, Xiaohan Wang, Ningyu Zhang, Tongtong Wu, Yuxiang Wang, Yongheng Wang, Huajun Chen

Current Multimodal Knowledge Graph Construction (MKGC) models struggle with the real-world dynamism of continuously emerging entities and relations, often succumbing to catastrophic forgetting-loss of previously acquired knowledge. This study introduces benchmarks aimed at fostering the development of the continual MKGC domain. We further introduce MSPT framework, designed to surmount the shortcomings of existing MKGC approaches during multimedia data processing. MSPT harmonizes the retention of learned knowledge (stability) and the integration of new data (plasticity), outperforming current continual learning and multimodal methods. Our results confirm MSPT's superior performance in evolving knowledge environments, showcasing its capacity to navigate balance between stability and plasticity.

📄 PDF Abstract BibTeX arXiv:2305.08698

Code (1)

zjunlp/ContinueMKGC 공식 구현 pytorch

Tasks

Continual Learninggraph constructionNavigateRelation Extraction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Adam 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

When Modalities Remember: Continual Learning for Multimodal Knowledge Graphs

2026-04-03 · Linyu Li, Zhi Jin, Yichi Zhang, Dongming Jin 외 arxiv

Real-world multimodal knowledge graphs (MMKGs) are dynamic, with new entities, relations, and multimodal knowledge emerging over time. Existing continual knowledge graph reasoning (CKGR) methods focus on structural tripl…

Continual LearningKnowledge Graphs

CMKL: Modality-Aware Continual Learning for Evolving Biomedical Knowledge Graphs

2026-05-11 · Yousef A. Radwan, Yao Li, Qing Qing, Ziqi Xu 외 arxiv

Biomedical knowledge graphs are increasingly large, dynamic, and multimodal, driven by rapid advances in biotechnology such as high-throughput sequencing. Machine learning models can infer previously unobserved biomedica…

Knowledge Graph EmbeddingContinual LearningKnowledge Graphs

Few-shot Continual Relation Extraction via Open Information Extraction

2025-02-23 · Thiem Nguyen, Anh Nguyen, Quyen Tran, Tu Vu 외

Typically, Few-shot Continual Relation Extraction (FCRE) models must balance retaining prior knowledge while adapting to new tasks with extremely limited data. However, real-world scenarios may also involve unseen or und…

Continual LearningContinual Relation Extractiongraph constructionOpen Information Extraction+2

UNIT: Unleash Large Language Models Potential for Graph Continual Learning

2026-07-11 · Tairan Huang, Yili Wang, Beibei Hu, Yiting Shi 외 arxiv

In real-world multimodal web scenarios, graph-structured data often arrives in a streaming manner, making graph continual learning a crucial paradigm for continuously modeling such evolving structures. However, existing …

Continual LearningGeneral Knowledge

Federated Continual Graph Learning

2024-11-28 · Yinlin Zhu, Miao Hu, Di wu

Managing evolving graph data presents substantial challenges in storage and privacy, and training graph neural networks (GNNs) on such data often leads to catastrophic forgetting, impairing performance on earlier tasks. …

Continual LearningGraph LearningTransfer Learning