paper-with-me

홈 › Papers

Hypervector Design for Efficient Hyperdimensional Computing on Edge Devices

2021-03-08 · Toygun Basaklar, Yigit Tuncel, Shruti Yadav Narayana, Suat Gumussoy, Umit Y. Ogras

Hyperdimensional computing (HDC) has emerged as a new light-weight learning algorithm with smaller computation and energy requirements compared to conventional techniques. In HDC, data points are represented by high-dimensional vectors (hypervectors), which are mapped to high-dimensional space (hyperspace). Typically, a large hypervector dimension ($\geq1000$) is required to achieve accuracies comparable to conventional alternatives. However, unnecessarily large hypervectors increase hardware and energy costs, which can undermine their benefits. This paper presents a technique to minimize the hypervector dimension while maintaining the accuracy and improving the robustness of the classifier. To this end, we formulate the hypervector design as a multi-objective optimization problem for the first time in the literature. The proposed approach decreases the hypervector dimension by more than $32\times$ while maintaining or increasing the accuracy achieved by conventional HDC. Experiments on a commercial hardware platform show that the proposed approach achieves more than one order of magnitude reduction in model size, inference time, and energy consumption. We also demonstrate the trade-off between accuracy and robustness to noise and provide Pareto front solutions as a design parameter in our hypervector design.

📄 PDF Abstract BibTeX arXiv:2103.06709

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hardware Optimizations of Dense Binary Hyperdimensional Computing: Rematerialization of Hypervectors, Binarized Bundling, and Combinational Associative Memory

2018-07-20 · Manuel Schmuck, Luca Benini, Abbas Rahimi

Brain-inspired hyperdimensional (HD) computing models neural activity patterns of the very size of the brain's circuits with points of a hyperdimensional space, that is, with hypervectors. Hypervectors are $D$-dimensiona…

THDC: Training Hyperdimensional Computing Models with Backpropagation

2026-01-27 · Hanne Dejonghe, Sam Leroux arxiv

Hyperdimensional computing (HDC) offers lightweight learning for energy-constrained devices by encoding data into high-dimensional vectors. However, its reliance on ultra-high dimensionality and static, randomly initiali…

Gluing Neural Networks Symbolically Through Hyperdimensional Computing

2022-05-31 · Peter Sutor, Dehao Yuan, Douglas Summers-Stay, Cornelia Fermuller 외

Hyperdimensional Computing affords simple, yet powerful operations to create long Hyperdimensional Vectors (hypervectors) that can efficiently encode information, be used for learning, and are dynamic enough to be modifi…

Clo-HDnn: A 4.66 TFLOPS/W and 3.78 TOPS/W Continual On-Device Learning Accelerator with Energy-efficient Hyperdimensional Computing via Progressive Search

2025-07-23 · Chang Eun Song, Weihong Xu, Keming Fan, Soumil Jain 외 arxiv

Clo-HDnn is an on-device learning (ODL) accelerator designed for emerging continual learning (CL) tasks. Clo-HDnn integrates hyperdimensional computing (HDC) along with low-cost Kronecker HD Encoder and weight clustering…

Continual Learning

uHD: Unary Processing for Lightweight and Dynamic Hyperdimensional Computing

2023-11-16 · Sercan Aygun, Mehran Shoushtari Moghadam, M. Hassan Najafi

Hyperdimensional computing (HDC) is a novel computational paradigm that operates on long-dimensional vectors known as hypervectors. The hypervectors are constructed as long bit-streams and form the basic building blocks …

Position