paper-with-me

Papers

SNAP: Low-Latency Test-Time Adaptation with Sparse Updates

2025-11-19 · Hyeongheon Cha, Dong Min Kim, Hye Won Chung, Taesik Gong, Sung-Ju Lee arxiv

Test-Time Adaptation (TTA) adjusts models using unlabeled test data to handle dynamic distribution shifts. However, existing methods rely on frequent adaptation and high computational cost, making them unsuitable for resource-constrained edge environments. To address this, we propose SNAP, a sparse TTA framework that reduces adaptation frequency and data usage while preserving accuracy. SNAP maintains competitive accuracy even when adapting based on only 1% of the incoming data stream, demonstrating its robustness under infrequent updates. Our method introduces two key components: (i) Class and Domain Representative Memory (CnDRM), which identifies and stores a small set of samples that are representative of both class and domain characteristics to support efficient adaptation with limited data; and (ii) Inference-only Batch-aware Memory Normalization (IoBMN), which dynamically adjusts normalization statistics at inference time by leveraging these representative samples, enabling efficient alignment to shifting target domains. Integrated with five state-of-the-art TTA algorithms, SNAP reduces latency by up to 93.12%, while keeping the accuracy drop below 3.3%, even across adaptation rates ranging from 1% to 50%. This demonstrates its strong potential for practical use on edge devices serving latency-sensitive applications. The source code is available at https://github.com/chahh9808/SNAP.

📄 PDF Abstract BibTeX arXiv:2511.15276

Code (0)

등록된 구현이 없습니다.

Tasks

Test-time Adaptation

Similar Papers 제목 키워드 기반

PromptDyG: Test-Time Prompt Adaptation on Dynamic Graphs

2026-06-22 · Guoguo Ai, Chaoxi Niu, Hui Yan, Joey Tianyi Zhou 외 arxiv

Activities in numerous evolving systems can be represented as dynamic graphs in snapshot form at different time intervals, i.e., discrete-time dynamic graphs (DTDGs). Existing methods show impressive advances in capturin…

Graph Learning

OnDA: On-device Channel Pruning for Efficient Personalized Keyword Spotting

2026-02-25 · Matteo Risso, Alessio Burrello, Daniele Jahier Pagliari arxiv

Always-on keyword spotting (KWS) demands on-device adaptation to cope with user- and environment-specific distribution shifts under tight latency and energy budgets. This paper proposes, for the first time, coupling weig…

Keyword Spotting

Interpretable and Efficient Beamforming-Based Deep Learning for Single Snapshot DOA Estimation

2023-09-14 · Ruxin Zheng, Shunqiao Sun, Hongshan Liu, Honglei Chen 외

We introduce an interpretable deep learning approach for direction of arrival (DOA) estimation with a single snapshot. Classical subspace-based methods like MUSIC and ESPRIT use spatial smoothing on uniform linear arrays…

Compressive SensingDeep Learning

A Practical Sparse Approximation for Real Time Recurrent Learning

2020-06-12 · Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero 외

Current methods for training recurrent neural networks are based on backpropagation through time, which requires storing a complete history of network states, and prohibits updating the weights `online' (after every time…

Practical Real Time Recurrent Learning with a Sparse Approximation

2021-01-01 · ICLR 2021 1 · Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero 외

Recurrent neural networks are usually trained with backpropagation through time, which requires storing a complete history of network states, and prohibits updating the weights "online" (after every timestep). Real Time …