paper-with-me

홈 › Papers

Algebraic Dynamical Systems in Machine Learning

2023-11-06 · Iolo Jones, Jerry Swan, Jeffrey Giansiracusa

We introduce an algebraic analogue of dynamical systems, based on term rewriting. We show that a recursive function applied to the output of an iterated rewriting system defines a formal class of models into which all the main architectures for dynamic machine learning models (including recurrent neural networks, graph neural networks, and diffusion models) can be embedded. Considered in category theory, we also show that these algebraic models are a natural language for describing the compositionality of dynamic models. Furthermore, we propose that these models provide a template for the generalisation of the above dynamic models to learning problems on structured or non-numerical data, including 'hybrid symbolic-numeric' models.

📄 PDF Abstract BibTeX arXiv:2311.03118

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Computational Dynamical Systems

2024-09-18 · Jordan Cotler, Semon Rezchikov

We study the computational complexity theory of smooth, finite-dimensional dynamical systems. Building off of previous work, we give definitions for what it means for a smooth dynamical system to simulate a Turing machin…

The $k$-Compound of a Difference-Algebraic System

2021-11-02 · Ron Ofir, Michael Margaliot

The multiplicative and additive compounds of a matrix have important applications in geometry, linear algebra, and the analysis of dynamical systems. In particular, the $k$-compounds allow to build a $k$-compound dynamic…

Learnable & Interpretable Model Combination in Dynamical Systems Modeling

2024-06-12 · Tobias Thummerer, Lars Mikelsons

During modeling of dynamical systems, often two or more model architectures are combined to obtain a more powerful or efficient model regarding a specific application area. This covers the combination of multiple machine…

modelPhysical Simulations

Causal discovery in deterministic discrete LTI-DAE systems

2025-06-25 · Bala Rajesh Konkathi, Arun K. Tangirala

Discovering pure causes or driver variables in deterministic LTI systems is of vital importance in the data-driven reconstruction of causal networks. A recent work by Kathari and Tangirala, proposed in 2022, formulated t…

Causal Discovery

Algebraic Systems Biology: A Case Study for the Wnt Pathway

2015-02-11

Steady state analysis of dynamical systems for biological networks give rise to algebraic varieties in high-dimensional spaces whose study is of interest in their own right. We demonstrate this for the shuttle model of t…