paper-with-me

Papers

Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networks

2021-06-02 · Antonello Rosato, Massimo Panella, Denis Kleyko

In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inference approaches. In particular, randomized algorithms are currently having a resurgence, given their generalized elementary approach. By using randomized neural networks, we study distributed classification, which can be employed in situations were data cannot be stored at a central location nor shared. We propose a more efficient solution for distributed classification by making use of a lossy compression approach applied when sharing the local classifiers with other agents. This approach originates from the framework of hyperdimensional computing, and is adapted herein. The results of experiments on a collection of datasets demonstrate that the proposed approach has usually higher accuracy than local classifiers and getting close to the benchmark - the centralized classifier. This work can be considered as the first step towards analyzing the variegated horizon of distributed randomized neural networks.

📄 PDF Abstract BibTeX arXiv:2106.00881

Code (0)

등록된 구현이 없습니다.

Tasks

Classification

Similar Papers 제목 키워드 기반

On Effects of Compression with Hyperdimensional Computing in Distributed Randomized Neural Networks

2021-06-17 · Antonello Rosato, Massimo Panella, Evgeny Osipov, Denis Kleyko

A change of the prevalent supervised learning techniques is foreseeable in the near future: from the complex, computational expensive algorithms to more flexible and elementary training ones. The strong revitalization of…

Dimensionality ReductionQuantization

In-memory hyperdimensional computing

2019-06-04 · Geethan Karunaratne, Manuel Le Gallo, Giovanni Cherubini, Luca Benini 외

Hyperdimensional computing (HDC) is an emerging computational framework that takes inspiration from attributes of neuronal circuits such as hyperdimensionality, fully distributed holographic representation, and (pseudo)r…

AttributeClassificationGeneral ClassificationGesture Recognition+3

Optical hyperdimensional soft sensing: Speckle-based touch interface and tactile sensor

2024-01-06 · Kei Kitagawa, Kohei Tsuji, Koyo Sagehashi, Tomoaki Niiyama 외

Hyperdimensional computing (HDC) is an emerging computing paradigm that exploits the distributed representation of input data in a hyperdimensional space, the dimensions of which are typically between 1,000--10,000. The …

Zero-shot Classification using Hyperdimensional Computing

2024-01-30 · Samuele Ruffino, Geethan Karunaratne, Michael Hersche, Luca Benini 외

Classification based on Zero-shot Learning (ZSL) is the ability of a model to classify inputs into novel classes on which the model has not previously seen any training examples. Providing an auxiliary descriptor in the …

AttributeAttribute ExtractionClassificationzero-shot-classification+1

HyperEmbed: Tradeoffs Between Resources and Performance in NLP Tasks with Hyperdimensional Computing enabled Embedding of n-gram Statistics

2020-03-03 · Pedro Alonso, Kumar Shridhar, Denis Kleyko, Evgeny Osipov 외

Recent advances in Deep Learning have led to a significant performance increase on several NLP tasks, however, the models become more and more computationally demanding. Therefore, this paper tackles the domain of comput…