Restoring Chaos Using Deep Reinforcement Learning

2019-11-27 · Sumit Vashishtha, Siddhartha Verma

A catastrophic bifurcation in non-linear dynamical systems, called crisis, often leads to their convergence to an undesirable non-chaotic state after some initial chaotic transients. Preventing such behavior has proved to be quite challenging. We demonstrate that deep Reinforcement Learning (RL) is able to restore chaos in a transiently-chaotic regime of the Lorenz system of equations. Without requiring any a priori knowledge of the underlying dynamics of the governing equations, the RL agent discovers an effective perturbation strategy for sustaining the chaotic trajectory. We analyze the agent's autonomous control-decisions, and identify and implement a simple control-law that successfully restores chaos in the Lorenz system. Our results demonstrate the utility of using deep RL for controlling the occurrence of catastrophes and extreme-events in non-linear dynamical systems.

📄 PDF Abstract BibTeX arXiv:1912.00947

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Scalable photonic reinforcement learning by time-division multiplexing of laser chaos

2018-03-26 · Makoto Naruse, Takatomo Mihana, Hirokazu Hori, Hayato Saigo 외

Reinforcement learning involves decision making in dynamic and uncertain environments and constitutes a crucial element of artificial intelligence. In our previous work, we experimentally demonstrated that the ultrafast …

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+2

Chaos-based reinforcement learning with TD3

2024-05-15 · Toshitaka Matsuki, Yusuke Sakemi, Kazuyuki Aihara

Chaos-based reinforcement learning (CBRL) is a method in which the agent's internal chaotic dynamics drives exploration. This approach offers a model for considering how the biological brain can create variability in its…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Stable Acoustic Relay Assignment with High Throughput via Lase Chaos-based Reinforcement Learning

2025-07-08 · Zengjing Chen, Lu Wang, Chengzhi Xing

This study addresses the problem of stable acoustic relay assignment in an underwater acoustic network. Unlike the objectives of most existing literature, two distinct objectives, namely classical stable arrangement and …

Decision Making

NeuralChaos: Optimal Adapted Approximation of Square Integrable Predictable Processes

2026-07-15 · Anastasis Kratsios, Giulia Livieri, Philipp Schmocker arxiv

We address fundamental challenges in representing and computing $\mathbb{R}^{d}$-valued predictable square-integrable processes over $[0,T]$, collected in the space $\mathcal{H}^2_T(\mathbb{R}^{d})$. These processes are …

Reinforcement Learning

Ultrafast photonic reinforcement learning based on laser chaos

2017-04-14 · Makoto Naruse, Yuta Terashima, Atsushi Uchida, Song-Ju Kim

Reinforcement learning involves decision making in dynamic and uncertain environments, and constitutes one important element of artificial intelligence (AI). In this paper, we experimentally demonstrate that the ultrafas…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)