paper-with-me

홈 › Papers

Sobol Sequence Optimization for Hardware-Efficient Vector Symbolic Architectures

2023-11-17 · Sercan Aygun, M. Hassan Najafi

Hyperdimensional computing (HDC) is an emerging computing paradigm with significant promise for efficient and robust learning. In HDC, objects are encoded with high-dimensional vector symbolic sequences called hypervectors. The quality of hypervectors, defined by their distribution and independence, directly impacts the performance of HDC systems. Despite a large body of work on the processing parts of HDC systems, little to no attention has been paid to data encoding and the quality of hypervectors. Most prior studies have generated hypervectors using inherent random functions, such as MATLABs or Pythons random function. This work introduces an optimization technique for generating hypervectors by employing quasi-random sequences. These sequences have recently demonstrated their effectiveness in achieving accurate and low-discrepancy data encoding in stochastic computing systems. The study outlines the optimization steps for utilizing Sobol sequences to produce high-quality hypervectors in HDC systems. An optimization algorithm is proposed to select the most suitable Sobol sequences for generating minimally correlated hypervectors, particularly in applications related to symbol-oriented architectures. The performance of the proposed technique is evaluated in comparison to two traditional approaches of generating hypervectors based on linear-feedback shift registers and MATLAB random function. The evaluation is conducted for two applications: (i) language and (ii) headline classification. Our experimental results demonstrate accuracy improvements of up to 10.79%, depending on the vector size. Additionally, the proposed encoding hardware exhibits reduced energy consumption and a superior area-delay product.

📄 PDF Abstract BibTeX arXiv:2311.10277

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Shift-Equivariant Similarity-Preserving Hypervector Representations of Sequences

2021-12-31 · Dmitri A. Rachkovskij

Hyperdimensional Computing (HDC), also known as Vector-Symbolic Architectures (VSA), is a promising framework for the development of cognitive architectures and artificial intelligence systems, as well as for technical a…

Towards Efficient Neuro-Symbolic AI: From Workload Characterization to Hardware Architecture

2024-09-20 · Zishen Wan, Che-Kai Liu, Hanchen Yang, Ritik Raj 외

The remarkable advancements in artificial intelligence (AI), primarily driven by deep neural networks, are facing challenges surrounding unsustainable computational trajectories, limited robustness, and a lack of explain…

Graded Transformers

2025-07-27 · Tony Shaska arxiv

We introduce the Graded Transformer framework, a new class of sequence models that embeds algebraic inductive biases through grading transformations on vector spaces. Extending Graded Neural Networks (GNNs), we propose t…

Structured Prediction

Hyperseed: Unsupervised Learning with Vector Symbolic Architectures

2021-10-15 · Evgeny Osipov, Sachin Kahawala, Dilantha Haputhanthri, Thimal Kempitiya 외

Motivated by recent innovations in biologically-inspired neuromorphic hardware, this article presents a novel unsupervised machine learning algorithm named Hyperseed that draws on the principles of Vector Symbolic Archit…

Few-Shot LearningLanguage Identification

Symbolic Feedforward Networks for Probabilistic Finite Automata: Exact Simulation and Learnability

2025-09-12 · Sahil Rajesh Dhayalkar arxiv

We present a formal and constructive theory showing that probabilistic finite automata (PFAs) can be exactly simulated using symbolic feedforward neural networks. Our architecture represents state distributions as vector…