paper-with-me

홈 › Papers

CLARE: Continual Learning for Vision-Language-Action Models via Autonomous Adapter Routing and Expansion

2026-01-14 · Ralf Römer, Yi Zhang, Yuming Li, Angela P. Schoellig arxiv

To teach robots complex manipulation tasks, a common approach is to fine-tune a pre-trained vision-language-action model (VLA) on task-specific data. However, since this recipe updates existing representations, it is unsuitable for long-term operation in the real world, where robots must continually adapt to new tasks and environments while retaining the knowledge they have already acquired. Existing continual learning methods for robotics commonly require storing previous data (exemplars), struggle with long task sequences, or rely on task identifiers for deployment. To address these limitations, we propose CLARE, a general, parameter-efficient framework for exemplar-free continual learning with VLAs. CLARE introduces lightweight modular adapters into selected VLA modules and autonomously expands the model only where necessary when learning a new task, guided by layer-wise feature similarity. During deployment, an autoencoder-based routing mechanism dynamically activates the most relevant adapters without requiring task labels. Through extensive experiments on the LIBERO benchmark and five real-world tasks, we show that CLARE achieves high performance on new tasks without catastrophic forgetting of earlier tasks, significantly outperforming even exemplar-based methods. Code, data, and videos are available at our website: https://tum-lsy.github.io/clare.

📄 PDF Abstract BibTeX arXiv:2601.09512

Code (0)

등록된 구현이 없습니다.

Tasks

Continual Learning

Similar Papers 제목 키워드 기반

CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Framework

2026-09-15 · Yunxiang Fu, Meng Lou, Zicheng Liao, Yizhou Yu arxiv

Continual learning must balance the learning of new knowledge with the retention of previously learned knowledge to incrementally learn tasks from a data stream without catastrophic forgetting. While leveraging pretraine…

Continual Learning

Realistic Continual Learning Approach using Pre-trained Models

2024-04-11 · Nadia Nasri, Carlos Gutiérrez-Álvarez, Sergio Lafuente-Arroyo, Saturnino Maldonado-Bascón 외

Continual learning (CL) is crucial for evaluating adaptability in learning solutions to retain knowledge. Our research addresses the challenge of catastrophic forgetting, where models lose proficiency in previously learn…

class-incremental learningClass Incremental LearningContinual LearningIncremental Learning

VLM-C4L: Continual Core Dataset Learning with Corner Case Optimization via Vision-Language Models for Autonomous Driving

2025-03-29 · Haibo Hu, Jiacheng Zuo, Yang Lou, Yufei Cui 외

With the widespread adoption and deployment of autonomous driving, handling complex environments has become an unavoidable challenge. Due to the scarcity and diversity of extreme scenario datasets, current autonomous dri…

Autonomous DrivingContinual Learning

Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching

2026-09-01 · Jaewoo Park, Minyoung Lee, Sukmin Seo, Moonbin Yim 외 hf

Multimodal Large Language Models (MLLMs) are strong perceivers of images and video. We ask how far that reach extends into acting: dropping an MLLM directly into a drone's control loop, with its entire action space decla…

When Trust Collides: Decoding Human-LLM Cooperation Dynamics through the Prisoner's Dilemma

2025-03-10 · Guanxuan Jiang, Shirao Yang, Yuyang Wang, Pan Hui

As large language models (LLMs) become increasingly capable of autonomous decision-making, they introduce new challenges and opportunities for human-AI cooperation in mixed-motive contexts. While prior research has prima…

AI AgentLanguage ModelingLanguage ModellingLarge Language Model