paper-with-me

Papers

ReLaTS: a Reinforcement Learning-based method for dynamically determining the coupling Time Step in multi-scale simulations of self-gravitating systems

2026-06-18 · Veronica Saz Ulibarrena, Simon Portegies Zwart arxiv

Astrophysical simulations frequently address multi-scale, multi-physics problems through subsystem decomposition, problem-tailored integration schemes, and coupling on fixed manually set timescales. Here we introduce ReLaTS, a reinforcement learning framework that dynamically selects the coupling time step to optimize the trade-off between accuracy and computational cost. We validate ReLaTS on star clusters containing a planetary system, and test the method by varying the number of stars $N_\star$ in the cluster and the number of planets ($N_{\rm planet}$) orbiting one of them. The method finds the optimal coupling time step that balances speed and accuracy without requiring expert knowledge. In addition, the trained network operates independently of the coupled \textit{N}-body algorithms, displaying stable performance across a range of setups. We observe that the method is less reliable for cases with infinitesimal masses, as their contribution to the total energy is negligible compared to that of the massive bodies, and the network is not capable of recognizing potential errors generated while integrating them. For long-time integration of large $N$ systems, the error accumulates. The reinforcement learning algorithm, however, manages to keep the energy error below a pre-set threshold. This approach substantially reduces energy errors relative to fixed-time step baselines without substantial additional computational overhead. Once trained, ReLaTS requires no expert tuning and generalizes across diverse astrophysical domains, enabling adaptive multi-scale simulations.

📄 PDF Abstract BibTeX arXiv:2606.20832

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Predicting the State of Synchronization of Financial Time Series using Cross Recurrence Plots

2022-10-26 · Mostafa Shabani, Martin Magris, George Tzagkarakis, Juho Kanniainen 외

Cross-correlation analysis is a powerful tool for understanding the mutual dynamics of time series. This study introduces a new method for predicting the future state of synchronization of the dynamics of two financial t…

Time SeriesTime Series Analysis

RL-AWB: Deep Reinforcement Learning for Auto White Balance Correction in Low-Light Night-time Scenes

2026-01-08 · Yuan-Kang Lee, Kuan-Lin Chen, Chia-Che Chang, Yu-Lun Liu arxiv

Nighttime color constancy still remains a challenging problem in computational photography due to low-light noise and complex illumination conditions. We present RL-AWB, a novel framework combining statistical methods wi…

Reinforcement LearningColor Constancy

Using dynamic extensions for the backstepping control of hyperbolic systems

2024-11-28 · Nicole Gehring, Joachim Deutscher, Abdurrahman Irscheid

This paper systematically introduces dynamic extensions for the boundary control of general heterodirectional hyperbolic PDE systems. These extensions, which are well known in the finite-dimensional setting, constitute t…

A Safe Reinforcement Learning driven Weights-varying Model Predictive Control for Autonomous Vehicle Motion Control

2024-02-04 · Baha Zarrouki, Marios Spanakakis, Johannes Betz

Determining the optimal cost function parameters of Model Predictive Control (MPC) to optimize multiple control objectives is a challenging and time-consuming task. Multiobjective Bayesian Optimization (BO) techniques so…

Bayesian OptimizationDeep Reinforcement LearningModel Predictive ControlReinforcement Learning (RL)+1

Multi-Phase Locking Value: A Generalized Method for Determining Instantaneous Multi-frequency Phase Coupling

2021-02-20 · Bhavya Vasudeva, Runfeng Tian, Dee H. Wu, Shirley A. James 외

Many physical, biological and neural systems behave as coupled oscillators, with characteristic phase coupling across different frequencies. Methods such as $n:m$ phase locking value and bi-phase locking value have previ…