paper-with-me

Papers

Exploiting Chaotic Dynamics as Deep Neural Networks

2024-05-29 · Shuhong Liu, Nozomi Akashi, Qingyao Huang, Yasuo Kuniyoshi, Kohei Nakajima

Chaos presents complex dynamics arising from nonlinearity and a sensitivity to initial states. These characteristics suggest a depth of expressivity that underscores their potential for advanced computational applications. However, strategies to effectively exploit chaotic dynamics for information processing have largely remained elusive. In this study, we reveal that the essence of chaos can be found in various state-of-the-art deep neural networks. Drawing inspiration from this revelation, we propose a novel method that directly leverages chaotic dynamics for deep learning architectures. Our approach is systematically evaluated across distinct chaotic systems. In all instances, our framework presents superior results to conventional deep neural networks in terms of accuracy, convergence speed, and efficiency. Furthermore, we found an active role of transient chaos formation in our scheme. Collectively, this study offers a new path for the integration of chaos, which has long been overlooked in information processing, and provides insights into the prospective fusion of chaotic dynamics within the domains of machine learning and neuromorphic computation.

📄 PDF Abstract BibTeX arXiv:2406.02580

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Transient Chaos in BERT

2021-06-06 · Katsuma Inoue, Soh Ohara, Yasuo Kuniyoshi, Kohei Nakajima

Language is an outcome of our complex and dynamic human-interactions and the technique of natural language processing (NLP) is hence built on human linguistic activities. Bidirectional Encoder Representations from Transf…

KoopGen: Koopman Generator Networks for Representing and Predicting Dynamical Systems with Continuous Spectra

2026-02-15 · Liangyu Su, Jun Shu, Rui Liu, Deyu Meng 외 arxiv

Representing and predicting high-dimensional and spatiotemporally chaotic dynamical systems remains a fundamental challenge in dynamical systems and machine learning. Although data-driven models can achieve accurate shor…

Chaos and noise in evolutionary game dynamics

2025-03-28 · Maria Alejandra Ramirez, George Datseris, Arne Traulsen

Evolutionary game theory has traditionally employed deterministic models to describe population dynamics. These models, due to their inherent nonlinearities, can exhibit deterministic chaos, where population fluctuations…

Neural Networks as Geometric Chaotic Maps

2019-12-11 · Ziwei Li, Sai Ravela

The use of artificial neural networks as models of chaotic dynamics has been rapidly expanding. Still, a theoretical understanding of how neural networks learn chaos is lacking. Here, we employ a geometric perspective to…

Follow-the-Regularized-Leader Routes to Chaos in Routing Games

2021-02-16 · Jakub Bielawski, Thiparat Chotibut, Fryderyk Falniowski, Grzegorz Kosiorowski 외

We study the emergence of chaotic behavior of Follow-the-Regularized Leader (FoReL) dynamics in games. We focus on the effects of increasing the population size or the scale of costs in congestion games, and generalize r…