paper-with-me

Papers

When Modalities Remember: Continual Learning for Multimodal Knowledge Graphs

2026-04-03 · Linyu Li, Zhi Jin, Yichi Zhang, Dongming Jin, Yuanpeng He, Haoran Duan, Gadeng Luosang, Nyima Tashi arxiv

Real-world multimodal knowledge graphs (MMKGs) are dynamic, with new entities, relations, and multimodal knowledge emerging over time. Existing continual knowledge graph reasoning (CKGR) methods focus on structural triples and cannot fully exploit multimodal signals from new entities. Existing multimodal knowledge graph reasoning (MMKGR) methods, however, usually assume static graphs and suffer catastrophic forgetting as graphs evolve. To address this gap, we present a systematic study of continual multimodal knowledge graph reasoning (CMMKGR). We construct several continual multimodal knowledge graph benchmarks from existing MMKG datasets and propose MRCKG, a new CMMKGR model. Specifically, MRCKG employs a multimodal-structural collaborative curriculum to schedule progressive learning based on the structural connectivity of new triples to the historical graph and their multimodal compatibility. It also introduces a cross-modal knowledge preservation mechanism to mitigate forgetting through entity representation stability, relational semantic consistency, and modality anchoring. In addition, a multimodal contrastive replay scheme with a two-stage optimization strategy reinforces learned knowledge via multimodal importance sampling and representation alignment. Experiments on multiple datasets show that MRCKG preserves previously learned multimodal knowledge while substantially improving the learning of new knowledge.

📄 PDF Abstract BibTeX arXiv:2604.02778

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningKnowledge Graphs

Similar Papers 제목 키워드 기반

Remember Past, Anticipate Future: Learning Continual Multimodal Misinformation Detectors

2025-07-08 · Bing Wang, Ximing Li, Mengzhe Ye, Changchun Li 외

Nowadays, misinformation articles, especially multimodal ones, are widely spread on social media platforms and cause serious negative effects. To control their propagation, Multimodal Misinformation Detection (MMD) becom…

ArticlesContinual LearningMisinformation

MemVerse: Multimodal Memory for Lifelong Learning Agents

2025-12-03 · Junming Liu, Yifei Sun, Weihua Cheng, Haodong Lei 외 arxiv

Despite rapid progress in large-scale language and vision models, AI agents still suffer from a fundamental limitation: they cannot remember. Without reliable memory, agents catastrophically forget past experiences, stru…

Multimodal ReasoningContinual LearningKnowledge Graphs

Modality-Inconsistent Continual Learning of Multimodal Large Language Models

2024-12-17 · Weiguo Pian, Shijian Deng, Shentong Mo, Yunhui Guo 외

In this paper, we introduce Modality-Inconsistent Continual Learning (MICL), a new continual learning scenario for Multimodal Large Language Models (MLLMs) that involves tasks with inconsistent modalities (image, audio, …

Continual LearningKnowledge DistillationQuestion Answering

Continual-NExT: A Unified Comprehension And Generation Continual Learning Framework

2026-02-20 · Jingyang Qiao, Zhizhong Zhang, Xin Tan, Jingyu Gong 외 arxiv

Dual-to-Dual MLLMs refer to Multimodal Large Language Models, which can enable unified multimodal comprehension and generation through text and image modalities. Although exhibiting strong instantaneous learning and gene…

Continual Learning

MemEIC: A Step Toward Continual and Compositional Knowledge Editing

2025-10-29 · Jin Seong, Jiyun Park, Wencke Liermann, Hongseok Choi 외 arxiv

The dynamic nature of information necessitates continuously updating large vision-language models (LVLMs). While recent knowledge editing techniques hint at promising directions, they often focus on editing a single moda…

knowledge editing