paper-with-me

Papers

Generalized Learning Vector Quantization for Classification in Randomized Neural Networks and Hyperdimensional Computing

2021-06-17 · Cameron Diao, Denis Kleyko, Jan M. Rabaey, Bruno A. Olshausen

Machine learning algorithms deployed on edge devices must meet certain resource constraints and efficiency requirements. Random Vector Functional Link (RVFL) networks are favored for such applications due to their simple design and training efficiency. We propose a modified RVFL network that avoids computationally expensive matrix operations during training, thus expanding the network's range of potential applications. Our modification replaces the least-squares classifier with the Generalized Learning Vector Quantization (GLVQ) classifier, which only employs simple vector and distance calculations. The GLVQ classifier can also be considered an improvement upon certain classification algorithms popularly used in the area of Hyperdimensional Computing. The proposed approach achieved state-of-the-art accuracy on a collection of datasets from the UCI Machine Learning Repository - higher than previously proposed RVFL networks. We further demonstrate that our approach still achieves high accuracy while severely limited in training iterations (using on average only 21% of the least-squares classifier computational costs).

📄 PDF Abstract BibTeX arXiv:2106.09821

Code (1)

CameronDiao/GLVQ-For-Classification-In-Randomized-NN-And-HDC 공식 구현 pytorch

Tasks

BIG-bench Machine LearningQuantization

Similar Papers 제목 키워드 기반

On Effects of Compression with Hyperdimensional Computing in Distributed Randomized Neural Networks

2021-06-17 · Antonello Rosato, Massimo Panella, Evgeny Osipov, Denis Kleyko

A change of the prevalent supervised learning techniques is foreseeable in the near future: from the complex, computational expensive algorithms to more flexible and elementary training ones. The strong revitalization of…

Dimensionality ReductionQuantization

Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networks

2021-06-02 · Antonello Rosato, Massimo Panella, Denis Kleyko

In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inferen…

Classification

G-Net: A Provably Easy Construction of High-Accuracy Random Binary Neural Networks

2025-11-26 · Alireza Aghasi, Nicholas Marshall, Saeid Pourmand, Wyatt Whiting arxiv

We propose a novel randomized algorithm for constructing binary neural networks with tunable accuracy. This approach is motivated by hyperdimensional computing (HDC), which is a brain-inspired paradigm that leverages hig…

Generalized residual vector quantization for large scale data

2016-09-17 · Liu Shicong, Shao Junru, Lu Hongtao

Vector quantization is an essential tool for tasks involving large scale data, for example, large scale similarity search, which is crucial for content-based information retrieval and analysis. In this paper, we propose …

Information RetrievalQuantizationRetrieval

Activation Functions for Generalized Learning Vector Quantization - A Performance Comparison

2019-01-17 · Thomas Villmann, John Ravichandran, Andrea Villmann, David Nebel 외

An appropriate choice of the activation function (like ReLU, sigmoid or swish) plays an important role in the performance of (deep) multilayer perceptrons (MLP) for classification and regression learning. Prototype-based…

ClassificationGeneral ClassificationQuantizationregression