Programming Patterns in Dataflow Matrix Machines and Generalized Recurrent Neural Nets
Dataflow matrix machines arise naturally in the context of synchronous dataflow programming with linear streams. They can be viewed as a rather powerful generalization of recurrent neural networks. Similarly to recurrent neural networks, large classes of dataflow matrix machines are described by matrices of numbers, and therefore dataflow matrix machines can be synthesized by computing their matrices. At the same time, the evidence is fairly strong that dataflow matrix machines have sufficient expressive power to be a convenient general-purpose programming platform. Because of the network nature of this platform, programming patterns often correspond to patterns of connectivity in the generalized recurrent neural networks understood as programs. This paper explores a variety of such programming patterns.
Code (1)
Similar Papers 제목 키워드 기반
Dataflow matrix machines as programmable, dynamically expandable, self-referential generalized recurrent neural networks
Dataflow matrix machines are a powerful generalization of recurrent neural networks. They work with multiple types of linear streams and multiple types of neurons, including higher-order neurons which dynamically update …
Dataflow Matrix Machines as a Model of Computations with Linear Streams
We overview dataflow matrix machines as a Turing complete generalization of recurrent neural networks and as a programming platform. We describe vector space of finite prefix trees with numerical leaves which allows us t…
Dataflow Matrix Machines as a Generalization of Recurrent Neural Networks
Dataflow matrix machines are a powerful generalization of recurrent neural networks. They work with multiple types of arbitrary linear streams, multiple types of powerful neurons, and allow to incorporate higher-order co…
BIG-bench Machine LearningProbabilistic ProgrammingDataflow Matrix Machines and V-values: a Bridge between Programs and Neural Nets
1) Dataflow matrix machines (DMMs) generalize neural nets by replacing streams of numbers with linear streams (streams supporting linear combinations), allowing arbitrary input and output arities for activation functions…
Misam: Using ML in Dataflow Selection of Sparse-Sparse Matrix Multiplication
Sparse matrix-matrix multiplication (SpGEMM) is a critical operation in numerous fields, including scientific computing, graph analytics, and deep learning. These applications exploit the sparsity of matrices to reduce s…
Deep Reinforcement Learning