paper-with-me

Papers

Symbolic Hyperdimensional Vectors with Sparse Graph Convolutional Neural Networks

2022-09-30 · IJCNN 2022 9 · Cornell, Filip; Karlgren, Jussi; Animesh; Girdzijauskas, Šarūnas

In this paper, we propose a novel way of representing graphs for processing in Graph Neural Networks. We reduce the dimensionality of the input data by using Random Indexing, a Vector Symbolic Architectural framework; we implement a new trainable neural layer, also inspired by Vector Symbolic Architectures; we leverage the sparseness of the incoming data in a Sparse Neural Network framework. Our experiments on a number of publicly available datasets and standard benchmarks demonstrate that we can reduce the number of parameters by up to two orders of magnitude. We show how this parsimonious approach not only delivers competitive results but even improves performance for node classification and link prediction. We find that this holds in particular for cases where the graph lacks node features.

📄 PDF Abstract BibTeX

Code (1)

Filco306/GNN-random-indexing 공식 구현 pytorch

Tasks

Link PredictionNode Classification

Similar Papers 제목 키워드 기반

HDQMF: Holographic Feature Decomposition Using Quantum Algorithms

2024-01-01 · CVPR 2024 1 · Prathyush Prasanth Poduval, Zhuowen Zou, Mohsen Imani

This paper addresses the decomposition of holographic feature vectors in Hyperdimensional Computing (HDC) aka Vector Symbolic Architectures (VSA). HDC uses high-dimensional vectors with brain-like properties to repre…

Shift-Equivariant Similarity-Preserving Hypervector Representations of Sequences

2021-12-31 · Dmitri A. Rachkovskij

Hyperdimensional Computing (HDC), also known as Vector-Symbolic Architectures (VSA), is a promising framework for the development of cognitive architectures and artificial intelligence systems, as well as for technical a…

Gluing Neural Networks Symbolically Through Hyperdimensional Computing

2022-05-31 · Peter Sutor, Dehao Yuan, Douglas Summers-Stay, Cornelia Fermuller 외

Hyperdimensional Computing affords simple, yet powerful operations to create long Hyperdimensional Vectors (hypervectors) that can efficiently encode information, be used for learning, and are dynamic enough to be modifi…

Capacity Analysis of Vector Symbolic Architectures

2023-01-24 · Kenneth L. Clarkson, Shashanka Ubaru, Elizabeth Yang

Hyperdimensional computing (HDC) is a biologically-inspired framework which represents symbols with high-dimensional vectors, and uses vector operations to manipulate them. The ensemble of a particular vector space and a…

Dimensionality Reduction

The Hyperdimensional Transform for Distributional Modelling, Regression and Classification

2023-11-14 · Pieter Dewulf, Bernard De Baets, Michiel Stock

Hyperdimensional computing (HDC) is an increasingly popular computing paradigm with immense potential for future intelligent applications. Although the main ideas already took form in the 1990s, HDC recently gained signi…

Bayesian InferenceClassificationregressionRepresentation Learning