paper-with-me

Papers

LEAF: A Robust Expert-Based Framework for Few-Shot Continual Event Detection

2025-09-29 · Bao-Ngoc Dao, Quang Nguyen, Luyen Ngo Dinh, Minh Le, Linh Ngo Van arxiv

Few-shot Continual Event Detection (FCED) poses the dual challenges of learning from limited data and mitigating catastrophic forgetting across sequential tasks. Existing approaches often suffer from severe forgetting due to the full fine-tuning of a shared base model, which leads to knowledge interference between tasks. Moreover, they frequently rely on data augmentation strategies that can introduce unnatural or semantically distorted inputs. To address these limitations, we propose LEAF, a novel and robust expert-based framework for FCED. LEAF integrates a specialized mixture of experts architecture into the base model, where each expert is parameterized with low-rank adaptation (LoRA) matrices. A semantic-aware expert selection mechanism dynamically routes instances to the most relevant experts, enabling expert specialization and reducing knowledge interference. To improve generalization in limited-data settings, LEAF incorporates a contrastive learning objective guided by label descriptions, which capture high-level semantic information about event types. Furthermore, to prevent overfitting on the memory buffer, our framework employs a knowledge distillation strategy that transfers knowledge from previous models to the current one. Extensive experiments on multiple FCED benchmarks demonstrate that LEAF consistently achieves state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2509.24547

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge DistillationContrastive LearningData Augmentation

Similar Papers 제목 키워드 기반

Continual Few-shot Event Detection via Hierarchical Augmentation Networks

2024-03-26 · Chenlong Zhang, Pengfei Cao, Yubo Chen, Kang Liu 외

Traditional continual event detection relies on abundant labeled data for training, which is often impractical to obtain in real-world applications. In this paper, we introduce continual few-shot event detection (CFED), …

Event Detection

Interactive Visual Task Learning for Robots

2023-12-20 · Weiwei Gu, Anant Sah, Nakul Gopalan

We present a framework for robots to learn novel visual concepts and tasks via in-situ linguistic interactions with human users. Previous approaches have either used large pre-trained visual models to infer novel objects…

Continual LearningNovel ConceptsQuestion AnsweringVisual Question Answering+1

HyperHawkes: Hypernetwork based Neural Temporal Point Process

2022-10-01 · Manisha Dubey, P. K. Srijith, Maunendra Sankar Desarkar

Temporal point process serves as an essential tool for modeling time-to-event data in continuous time space. Despite having massive amounts of event sequence data from various domains like social media, healthcare etc., …

Continual LearningZero-Shot Learning

SEE: Continual Fine-tuning with Sequential Ensemble of Experts

2025-04-09 · Zhilin Wang, Yafu Li, Xiaoye Qu, Yu Cheng

Continual fine-tuning of large language models (LLMs) suffers from catastrophic forgetting. Rehearsal-based methods mitigate this problem by retaining a small set of old data. Nevertheless, they still suffer inevitable p…

Continual LearningMulti-Task Learning

CP-MoE: Consistency-Preserving Mixture-of-Experts for Continual Learning

2026-05-18 · Yang Liu, Toan Nguyen, Flora D. Salim arxiv

Catastrophic forgetting remains a major obstacle to continual learning in large language models (LLMs) and vision--language models (VLMs). Although Mixture-of-Experts (MoE) architectures offer an efficient path to scalin…

Continual LearningVisual Reasoning