paper-with-me

홈 › Papers

Randomized Policy Learning for Continuous State and Action MDPs

2020-06-08 · Hiteshi Sharma, Rahul Jain

Deep reinforcement learning methods have achieved state-of-the-art results in a variety of challenging, high-dimensional domains ranging from video games to locomotion. The key to success has been the use of deep neural networks used to approximate the policy and value function. Yet, substantial tuning of weights is required for good results. We instead use randomized function approximation. Such networks are not only cheaper than training fully connected networks but also improve the numerical performance. We present \texttt{RANDPOL}, a generalized policy iteration algorithm for MDPs with continuous state and action spaces. Both the policy and value functions are represented with randomized networks. We also give finite time guarantees on the performance of the algorithm. Then we show the numerical performance on challenging environments and compare them with deep neural network based algorithms.

📄 PDF Abstract BibTeX arXiv:2006.04331

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Perseus: Randomized Point-based Value Iteration for POMDPs

2011-09-09 · M. T. J. Spaan, N. Vlassis

Partially observable Markov decision processes (POMDPs) form an attractive and principled framework for agent planning under uncertainty. Point-based approximate techniques for POMDPs compute a policy based on a finite s…

Policy gradients in linearly-solvable MDPs

2010-12-01 · NeurIPS 2010 12 · Emanuel Todorov

We present policy gradient results within the framework of linearly-solvable MDPs. For the first time, compatible function approximators and natural policy gradients are obtained by estimating the cost-to-go function, ra…

Stochastic first-order methods for average-reward Markov decision processes

2022-05-11 · Tianjiao Li, Feiyang Wu, Guanghui Lan

We study average-reward Markov decision processes (AMDPs) and develop novel first-order methods with strong theoretical guarantees for both policy optimization and policy evaluation. Compared with intensive research effo…

Policy Gradient Methods

Deterministic Policy Gradient Primal-Dual Methods for Continuous-Space Constrained MDPs

2024-08-19 · Sergio Rozada, Dongsheng Ding, Antonio G. Marques, Alejandro Ribeiro

We study the problem of computing deterministic optimal policies for constrained Markov decision processes (MDPs) with continuous state and action spaces, which are widely encountered in constrained dynamical systems. De…

continuous-controlContinuous ControlPolicy Gradient MethodsRobot Navigation

Solving Long-run Average Reward Robust MDPs via Stochastic Games

2023-12-21 · Krishnendu Chatterjee, Ehsan Kafshdar Goharshady, Mehrdad Karrabi, Petr Novotný 외

Markov decision processes (MDPs) provide a standard framework for sequential decision making under uncertainty. However, MDPs do not take uncertainty in transition probabilities into account. Robust Markov decision proce…

Decision MakingDecision Making Under UncertaintySequential Decision Making