paper-with-me

Papers

Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardware

2024-05-02 · Madison Cotteret, Hugh Greatorex, Alpha Renner, Junren Chen, Emre Neftci, Huaqiang Wu, Giacomo Indiveri, Martin Ziegler, Elisabetta Chicca

Programming recurrent spiking neural networks (RSNNs) to robustly perform multi-timescale computation remains a difficult challenge. To address this, we describe a single-shot weight learning scheme to embed robust multi-timescale dynamics into attractor-based RSNNs, by exploiting the properties of high-dimensional distributed representations. We embed finite state machines into the RSNN dynamics by superimposing a symmetric autoassociative weight matrix and asymmetric transition terms, which are each formed by the vector binding of an input and heteroassociative outer-products between states. Our approach is validated through simulations with highly nonideal weights; an experimental closed-loop memristive hardware setup; and on Loihi 2, where it scales seamlessly to large state machines. This work introduces a scalable approach to embed robust symbolic computation through recurrent dynamics into neuromorphic hardware, without requiring parameter fine-tuning or significant platform-specific optimisation. Moreover, it demonstrates that distributed symbolic representations serve as a highly capable representation-invariant language for cognitive algorithms in neuromorphic hardware.

📄 PDF Abstract BibTeX arXiv:2405.01305

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Symbolic, Distributed and Distributional Representations for Natural Language Processing in the Era of Deep Learning: a Survey

2017-02-02 · Lorenzo Ferrone, Fabio Massimo Zanzotto

Natural language is inherently a discrete symbolic representation of human knowledge. Recent advances in machine learning (ML) and in natural language processing (NLP) seem to contradict the above intuition: discrete sym…

Parsing with CYK over Distributed Representations

2017-05-24 · Fabio Massimo Zanzotto, Giordano Cristini, Giorgio Satta

Syntactic parsing is a key task in natural language processing. This task has been dominated by symbolic, grammar-based parsers. Neural networks, with their distributed representations, are challenging these methods. In …

Recursive Binding for Similarity-Preserving Hypervector Representations of Sequences

2022-01-27 · Dmitri A. Rachkovskij, Denis Kleyko

Hyperdimensional computing (HDC), also known as vector symbolic architectures (VSA), is a computing framework used within artificial intelligence and cognitive computing that operates with distributed vector representati…

Word Similarity

Generative Neurosymbolic Machines

2020-10-23 · NeurIPS 2020 12 · Jindong Jiang, Sungjin Ahn

Reconciling symbolic and distributed representations is a crucial challenge that can potentially resolve the limitations of current deep learning. Remarkable advances in this direction have been achieved recently via gen…

Image Generation

A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations

2021-11-11 · Denis Kleyko, Dmitri A. Rachkovskij, Evgeny Osipov, Abbas Rahimi

This two-part comprehensive survey is devoted to a computing framework most commonly known under the names Hyperdimensional Computing and Vector Symbolic Architectures (HDC/VSA). Both names refer to a family of computati…

Electrical EngineeringSurvey