paper-with-me

홈 › Papers

SRMU: Relevance-Gated Updates for Streaming Hyperdimensional Memories

2026-04-16 · Shay Snyder, Andrew Capodieci, David Gorsich, Maryam Parsa arxiv

Sequential associative memories (SAMs) are difficult to build and maintain in real-world streaming environments, where observations arrive incrementally over time, have imbalanced sampling, and non-stationary temporal dynamics. Vector Symbolic Architectures (VSAs) provide a biologically-inspired framework for building SAMs. Entities and attributes are encoded as quasi-orthogonal hyperdimensional vectors and processed with well defined algebraic operations. Despite this rich framework, most VSA systems rely on simple additive updates, where repeated observations reinforce existing information even when no new information is introduced. In non-stationary environments, this leads to the persistence of stale information after the underlying system changes. In this work, we introduce the Sequential Relevance Memory Unit (SRMU), a domain- and cleanup-agnostic update rule for VSA-based SAMs. The SRMU combines temporal decay with a relevance gating mechanism. Unlike prior approaches that solely rely on cleanup, the SRMU regulates memory formation by filtering redundant, conflicting, and stale information before storage. We evaluate the SRMU on streaming state-tracking tasks that isolate non-uniform sampling and non-stationary temporal dynamics. Our results show that the SRMU increases memory similarity by $12.6\%$ and reduces cumulative memory magnitude by $53.5\%$. This shows that the SRMU produces more stable memory growth and stronger alignment with the ground-truth state.

📄 PDF Abstract BibTeX arXiv:2604.15121

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Feature-Selective Representation Misdirection for Machine Unlearning

2025-12-18 · Taozhao Chen, Linghan Huang, Kim-Kwang Raymond Choo, Huaming Chen arxiv

As large language models (LLMs) are increasingly adopted in safety-critical and regulated sectors, the retention of sensitive or prohibited knowledge introduces escalating risks, ranging from privacy leakage to regulator…

Streaming Encoding Algorithms for Scalable Hyperdimensional Computing

2022-09-20 · Anthony Thomas, Behnam Khaleghi, Gopi Krishna Jha, Sanjoy Dasgupta 외

Hyperdimensional computing (HDC) is a paradigm for data representation and learning originating in computational neuroscience. HDC represents data as high-dimensional, low-precision vectors which can be used for a variet…

ImageHD: Energy-Efficient On-Device Continual Learning of Visual Representations via Hyperdimensional Computing

2026-04-23 · Jebacyril Arockiaraj, Dhruv Parikh, Viktor Prasanna arxiv

On-device continual learning (CL) is critical for edge AI systems operating on non-stationary data streams, but most existing methods rely on backpropagation or exemplar-heavy classifiers, incurring substantial compute, …

Continual Learning

Online Sparse Streaming Feature Selection Using Adapted Classification

2023-02-25 · Ruiyang Xu, Di wu, Xin Luo

Traditional feature selections need to know the feature space before learning, and online streaming feature selection (OSFS) is proposed to process streaming features on the fly. Existing methods divide features into rel…

ClassificationFeature Correlationfeature selection

Encoding Robust Topological Signatures for Hyperdimensional Computing

2026-05-16 · Arpan Kusari arxiv

Hyperdimensional (HD) computing offers an attractive alternative to deep networks for edge learning due to its simplicity, fast prototype-based inference, and compatibility with online updates. However, standard pixel-ba…