Dataflow Matrix Machines as a Generalization of Recurrent Neural Networks

2016-03-29 · Michael Bukatin, Steve Matthews, Andrey Radul

Dataflow matrix machines are a powerful generalization of recurrent neural networks. They work with multiple types of arbitrary linear streams, multiple types of powerful neurons, and allow to incorporate higher-order constructions. We expect them to be useful in machine learning and probabilistic programming, and in the synthesis of dynamic systems and of deterministic and probabilistic programs.

📄 PDF Abstract BibTeX arXiv:1603.09002

Code (1)

anhinga/fluid

Tasks

BIG-bench Machine LearningProbabilistic Programming

Programming Patterns in Dataflow Matrix Machines and Generalized Recurrent Neural Nets

2016-06-30 · Michael Bukatin, Steve Matthews, Andrey Radul

Dataflow matrix machines arise naturally in the context of synchronous dataflow programming with linear streams. They can be viewed as a rather powerful generalization of recurrent neural networks. Similarly to recurrent…

Dataflow Matrix Machines as a Model of Computations with Linear Streams

2017-05-03 · Michael Bukatin, Jon Anthony

We overview dataflow matrix machines as a Turing complete generalization of recurrent neural networks and as a programming platform. We describe vector space of finite prefix trees with numerical leaves which allows us t…

Dataflow matrix machines as programmable, dynamically expandable, self-referential generalized recurrent neural networks

2016-05-17 · Michael Bukatin, Steve Matthews, Andrey Radul

Dataflow matrix machines are a powerful generalization of recurrent neural networks. They work with multiple types of linear streams and multiple types of neurons, including higher-order neurons which dynamically update …

Dataflow Matrix Machines and V-values: a Bridge between Programs and Neural Nets

2017-12-20 · Michael Bukatin, Jon Anthony

1) Dataflow matrix machines (DMMs) generalize neural nets by replacing streams of numbers with linear streams (streams supporting linear combinations), allowing arbitrary input and output arities for activation functions…

Dataflow Accelerator Architecture for Autonomous Machine Computing

2021-09-15 · Shaoshan Liu, Yuhao Zhu, Bo Yu, Jean-Luc Gaudiot 외

Commercial autonomous machines is a thriving sector, one that is likely the next ubiquitous computing platform, after Personal Computers (PC), cloud computing, and mobile computing. Nevertheless, a suitable computing sub…

Cloud Computing