Recent Developments in Machine Learning Methods for Stochastic Control and Games
Stochastic optimal control and games have a wide range of applications, from finance and economics to social sciences, robotics, and energy management. Many real-world applications involve complex models that have driven the development of sophisticated numerical methods. Recently, computational methods based on machine learning have been developed for solving stochastic control problems and games. In this review, we focus on deep learning methods that have unlocked the possibility of solving such problems, even in high dimensions or when the structure is very complex, beyond what traditional numerical methods can achieve. We consider mostly the continuous time and continuous space setting. Many of the new approaches build on recent neural-network-based methods for solving high-dimensional partial differential equations or backward stochastic differential equations, or on model-free reinforcement learning for Markov decision processes that have led to breakthrough results. This paper provides an introduction to these methods and summarizes the state-of-the-art works at the crossroad of machine learning and stochastic control and games.
Code (0)
등록된 구현이 없습니다.
Tasks
energy managementManagementSimilar Papers 제목 키워드 기반
Controlling dynamics of stochastic systems with deep reinforcement learning
A properly designed controller can help improve the quality of experimental measurements or force a dynamical system to follow a completely new time-evolution path. Recent developments in deep reinforcement learning have…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningGame-Theoretic Multiagent Reinforcement Learning
Following the remarkable success of the AlphaGo series, significant advances in multi-agent reinforcement learning (MARL) techniques have been witnessed. MARL corresponds to the learning problem in a multi-agent system i…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)A Stochastic Fundamental Lemma with Reduced Disturbance Data Requirements
Recently, the fundamental lemma by Willems et. al has been extended towards stochastic LTI systems subject to process disturbances. Using this lemma requires previously recorded data of inputs, outputs, and disturbances.…
LEMMANegative Dependence as a toolbox for machine learning : review and new developments
Negative dependence is becoming a key driver in advancing learning capabilities beyond the limits of traditional independence. Recent developments have evidenced support towards negatively dependent systems as a learning…
Dimensionality ReductionPoint ProcessesBig Learning with Bayesian Methods
Explosive growth in data and availability of cheap computing resources have sparked increasing interest in Big learning, an emerging subfield that studies scalable machine learning algorithms, systems, and applications w…
Bayesian InferenceBIG-bench Machine LearningDistributed Computing