Existence and Uniqueness of Solutions to the Stochastic Bellman Equation with Unbounded Shock
In this paper we develop a general framework to analyze stochastic dynamic problems with unbounded utility functions and correlated and unbounded shocks. We obtain new results of the existence and uniqueness of solutions to the Bellman equation through a general fixed point theorem that generalizes known results for Banach contractions and local contractions. We study an endogenous growth model as well as the Lucas asset pricing model in an exchange economy, significantly expanding their range of applicability.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
On solutions of the distributional Bellman equation
In distributional reinforcement learning not only expected returns but the complete return distributions of a policy are taken into account. The return distribution for a fixed policy is given as the solution of an assoc…
Distributional Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Stochastic Evolution Equations in Banach Spaces and Applications to Heath-Jarrow-Morton-Musiela Equation
In this paper we study the stochastic evolution equation (1.1) in martingale-type 2 Banach spaces (with the linear part of the drift being only a generator of a C0-semigroup). We prove the existence and the uniqueness of…
Hamilton-Jacobi-Bellman Equation Arising from Optimal Portfolio Selection Problem
The Hamilton-Jacobi-Bellman equation arising from the optimal portfolio selection problem is studied by means of the maximal monotone operator method. The existence and uniqueness of a solution to the Cauchy problem for …
On the Uniqueness of Solution for the Bellman Equation of LTL Objectives
Surrogate rewards for linear temporal logic (LTL) objectives are commonly utilized in planning problems for LTL objectives. In a widely-adopted surrogate reward approach, two discount factors are used to ensure that the …
Market making and incentives design in the presence of a dark pool: a deep reinforcement learning approach
We consider the issue of a market maker acting at the same time in the lit and dark pools of an exchange. The exchange wishes to establish a suitable make-take fees policy to attract transactions on its venues. We first …
Deep Reinforcement Learning