Corrected Soft Actor Critic for Continuous Control

2024-10-22 · Yanjun Chen, Xinming Zhang, Xianghui Wang, Zhiqiang Xu, Xiaoyu Shen, Wei zhang

The Soft Actor-Critic (SAC) algorithm is known for its stability and high sample efficiency in deep reinforcement learning. However, the tanh transformation applied to sampled actions in SAC distorts the action distribution, hindering the selection of the most probable actions. This paper presents a novel action sampling method that directly identifies and selects the most probable actions within the transformed distribution, thereby addressing this issue. Extensive experiments on standard continuous control benchmarks demonstrate that the proposed method significantly enhances SAC's performance, resulting in faster convergence and higher cumulative rewards compared to the original algorithm.

📄 PDF Abstract BibTeX arXiv:2410.16739

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-control Continuous ControlDeep Reinforcement Learning

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음

Dilated Convolution 설명 없음

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

SAC 설명 없음

Soft Decomposed Policy-Critic: Bridging the Gap for Effective Continuous Control with Discrete RL

2023-08-20 · Yechen Zhang, Jian Sun, Gang Wang, Zhuo Li 외

Discrete reinforcement learning (RL) algorithms have demonstrated exceptional performance in solving sequential decision tasks with discrete action spaces, such as Atari games. However, their effectiveness is hindered wh…

Atari Games continuous-control Continuous Control Reinforcement Learning (RL)

Langevin Soft Actor-Critic: Efficient Exploration through Uncertainty-Driven Critic Learning

2025-01-29 · Haque Ishfaq, Guangyuan Wang, Sami Nur Islam, Doina Precup

Existing actor-critic algorithms, which are popular for continuous control reinforcement learning (RL) tasks, suffer from poor sample efficiency due to lack of principled exploration mechanism within them. Motivated by t…

continuous-control Continuous Control Efficient Exploration Reinforcement Learning (RL)+1

Variational Quantum Soft Actor-Critic for Robotic Arm Control

2022-12-20 · Alberto Acuto, Paola Barillà, Ludovico Bozzolo, Matteo Conterno 외

Deep Reinforcement Learning is emerging as a promising approach for the continuous control task of robotic arm movement. However, the challenges of learning robust and versatile control capabilities are still far from be…

continuous-control Continuous Control Deep Reinforcement Learning reinforcement-learning+2

Wasserstein Barycenter Soft Actor-Critic

2025-06-11 · Zahra Shahrooei, Ali Baheri

Deep off-policy actor-critic algorithms have emerged as the leading framework for reinforcement learning in continuous control domains. However, most of these algorithms suffer from poor sample efficiency, especially in …

continuous-control Continuous Control MuJoCo

Softmax Deep Double Deterministic Policy Gradients

2020-10-19 · NeurIPS 2020 12 · Ling Pan, Qingpeng Cai, Longbo Huang

A widely-used actor-critic reinforcement learning algorithm for continuous control, Deep Deterministic Policy Gradients (DDPG), suffers from the overestimation problem, which can negatively affect the performance. Althou…

continuous-control Continuous Control