paper-with-me

홈 › Papers

Critical Patch-Aware Sparse Prompting with Decoupled Training for Continual Learning on the Edge

2026-04-08 · Wonseon Lim, Jaesung Lee, Dae-Won Kim arxiv

Continual learning (CL) on edge devices requires not only high accuracy but also training-time efficiency to support on-device adaptation under strict memory and computational constraints. While prompt-based continual learning (PCL) is parameter-efficient and achieves competitive accuracy, prior work has focused mainly on accuracy or inference-time performance, often overlooking the memory and computational costs of on-device training. In this paper, we propose CPS-Prompt, a critical patch-aware sparse prompting framework that explicitly targets training-time memory usage and computational cost by integrating critical patch sampling (CPS) for task-aware token reduction and decoupled prompt and classifier training (DPCT) to reduce backpropagation overhead. Experiments on three public benchmarks and real edge hardware show that CPS-Prompt improves peak memory, training time, and energy efficiency by about 1.6x over the balanced CODA-Prompt baseline, while maintaining accuracy within 2% of the state-of-the-art C-Prompt on average and remaining competitive with CODA-Prompt in accuracy. The code is available at https://github.com/laymond1/cps-prompt.

📄 PDF Abstract BibTeX arXiv:2604.07399

Code (0)

등록된 구현이 없습니다.

Tasks

Continual Learning

Similar Papers 제목 키워드 기반

How does Chain of Thought Think? Mechanistic Interpretability of Chain-of-Thought Reasoning with Sparse Autoencoding

2025-07-24 · Xi Chen, Aske Plaat, Niki van Stein arxiv

Chain-of-thought (CoT) prompting boosts Large Language Models accuracy on multi-step tasks, yet whether the generated "thoughts" reflect the true internal reasoning process is unresolved. We present the first feature-lev…

Not the Example, but the Process: How Self-Generated Examples Enhance LLM Reasoning

2026-01-26 · Daehoon Gwak, Minseo Jung, Junwoo Park, Minho Park 외 arxiv

Recent studies have shown that Large Language Models (LLMs) can improve their reasoning performance through self-generated few-shot examples, achieving results comparable to manually curated in-context examples. However,…

Revisiting Token Compression for Accelerating ViT-based Sparse Multi-View 3D Object Detectors

2026-04-16 · Mingqian Ji, Shanshan Zhang, Jian Yang arxiv

Vision Transformer (ViT)-based sparse multi-view 3D object detectors have achieved remarkable accuracy but still suffer from high inference latency due to heavy token processing. To accelerate these models, token compres…

UHR-DETR: Efficient End-to-End Small Object Detection for Ultra-High-Resolution Remote Sensing Imagery

2026-04-23 · Jingfang Li, Haoran Zhu, Wen Yang, Jinrui Zhang 외 arxiv

Ultra-High-Resolution (UHR) imagery has become essential for modern remote sensing, offering unprecedented spatial coverage. However, detecting small objects in such vast scenes presents a critical dilemma: retaining the…

Small Object Detection

Sparse Threats, Focused Defense: Criticality-Aware Robust Reinforcement Learning for Safe Autonomous Driving

2026-01-05 · Qi Wei, Junchao Fan, Zhao Yang, Jianhua Wang 외 arxiv

Reinforcement learning (RL) has shown considerable potential in autonomous driving (AD), yet its vulnerability to perturbations remains a critical barrier to real-world deployment. As a primary countermeasure, adversaria…

Reinforcement LearningAutonomous Driving