paper-with-me

홈 › Papers

In-memory factorization of holographic perceptual representations

2022-11-09 · Jovin Langenegger, Geethan Karunaratne, Michael Hersche, Luca Benini, Abu Sebastian, Abbas Rahimi

Disentanglement of constituent factors of a sensory signal is central to perception and cognition and hence is a critical task for future artificial intelligence systems. In this paper, we present a compute engine capable of efficiently factorizing holographic perceptual representations by exploiting the computation-in-superposition capability of brain-inspired hyperdimensional computing and the intrinsic stochasticity associated with analog in-memory computing based on nanoscale memristive devices. Such an iterative in-memory factorizer is shown to solve at least five orders of magnitude larger problems that cannot be solved otherwise, while also significantly lowering the computational time and space complexity. We present a large-scale experimental demonstration of the factorizer by employing two in-memory compute chips based on phase-change memristive devices. The dominant matrix-vector multiply operations are executed at O(1) thus reducing the computational time complexity to merely the number of iterations. Moreover, we experimentally demonstrate the ability to factorize visual perceptual representations reliably and efficiently.

📄 PDF Abstract BibTeX arXiv:2211.05052

Code (1)

ibm/in-memory-factorizer 공식 구현 pytorch

Tasks

Disentanglement

Similar Papers 제목 키워드 기반

H3DFact: Heterogeneous 3D Integrated CIM for Factorization with Holographic Perceptual Representations

2024-04-05 · Zishen Wan, Che-Kai Liu, Mohamed Ibrahim, Hanchen Yang 외

Disentangling attributes of various sensory signals is central to human-like perception and reasoning and a critical task for higher-order cognitive and neuro-symbolic AI systems. An elegant approach to represent this in…

Holographic Factorization Machines for Recommendation

2019-07-17 · AAAI 2019 7 · Yi Tay, Shuai Zhang, Anh Tuan Luu, Siu Cheung Hui 외

Factorization Machines (FMs) are a class of popular algorithms that have been widely adopted for collaborative filtering and recommendation tasks. FMs are characterized by its usage of the inner product of factorized par…

Collaborative FilteringRetrieval

Associative Long Short-Term Memory

2016-02-09 · Ivo Danihelka, Greg Wayne, Benigno Uria, Nal Kalchbrenner 외

We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based on complex-valued vectors and is closely …

MemorizationRetrieval

Holographic Embeddings of Knowledge Graphs

2015-10-16 · Maximilian Nickel, Lorenzo Rosasco, Tomaso Poggio

Learning embeddings of entities and relations is an efficient and versatile method to perform machine learning on relational data such as knowledge graphs. In this work, we propose holographic embeddings (HolE) to learn …

Knowledge GraphsLink PredictionRelational Reasoning

Learning to Rank Question Answer Pairs with Holographic Dual LSTM Architecture

2017-07-20 · Tay Yi, Phan Minh C., Tuan Luu Anh, Hui Siu Cheung

We describe a new deep learning architecture for learning to rank question answer pairs. Our approach extends the long short-term memory (LSTM) network with holographic composition to model the relationship between quest…

Feature EngineeringLearning-To-RankSentence