paper-with-me

Papers

Deep reinforcement learning for feedback control in a collective flashing ratchet

2020-11-20 · Dong-Kyum Kim, Hawoong Jeong

A collective flashing ratchet transports Brownian particles using a spatially periodic, asymmetric, and time-dependent on-off switchable potential. The net current of the particles in this system can be substantially increased by feedback control based on the particle positions. Several feedback policies for maximizing the current have been proposed, but optimal policies have not been found for a moderate number of particles. Here, we use deep reinforcement learning (RL) to find optimal policies, with results showing that policies built with a suitable neural network architecture outperform the previous policies. Moreover, even in a time-delayed feedback situation where the on-off switching of the potential is delayed, we demonstrate that the policies provided by deep RL provide higher currents than the previous strategies.

📄 PDF Abstract BibTeX arXiv:2011.10357

Code (1)

kdkyum/RatchetDRL 공식 구현 pytorch

Tasks

Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Similar Papers 제목 키워드 기반

Leveraging Environmental Correlations: The Thermodynamics of Requisite Variety

2016-09-17 · Alexander B. Boyd, Dibyendu Mandal, James P. Crutchfield

Key to biological success, the requisite variety that confronts an adaptive organism is the set of detectable, accessible, and controllable states in its environment. We analyze its role in the thermodynamic functioning …

Learning entropy production via neural networks

2020-03-09 · Dong-Kyum Kim, Youngkyoung Bae, Sangyun Lee, Hawoong Jeong

This Letter presents a neural estimator for entropy production, or NEEP, that estimates entropy production (EP) from trajectories of relevant variables without detailed information on the system dynamics. For steady stat…

Optimal ratcheting of dividend payout under Brownian motion surplus

2023-08-29 · Chonghu Guan, Zuo Quan Xu

This paper is concerned with a long standing optimal dividend payout problem subject to the so-called ratcheting constraint, that is, the dividend payout rate shall be non-decreasing over time and is thus self-path-depen…

Optimal Tracking Portfolio with A Ratcheting Capital Benchmark

2020-06-24 · Lijun Bo, Huafu Liao, Xiang Yu

This paper studies the finite horizon portfolio management by optimally tracking a ratcheting capital benchmark process. It is assumed that the fund manager can dynamically inject capital into the portfolio account such …

Management

Foundation Inference Models for Markov Jump Processes

2024-06-10 · David Berghaus, Kostadin Cvejoski, Patrick Seifner, Cesar Ojeda 외

Markov jump processes are continuous-time stochastic processes which describe dynamical systems evolving in discrete state spaces. These processes find wide application in the natural sciences and machine learning, but t…

Protein Folding