Regularization of Soft Actor-Critic Algorithms with Automatic Temperature Adjustment

2023-05-19 · Ben You

This work presents a comprehensive analysis to regularize the Soft Actor-Critic (SAC) algorithm with automatic temperature adjustment. The the policy evaluation, the policy improvement and the temperature adjustment are reformulated, addressing certain modification and enhancing the clarity of the original theory in a more explicit manner.

📄 PDF Abstract BibTeX arXiv:2305.11831

Code (0)

등록된 구현이 없습니다.

On the Convergence of Smooth Regularized Approximate Value Iteration Schemes

2020-12-01 · NeurIPS 2020 12 · Elena Smirnova, Elvis Dohmatob

Entropy regularization, smoothing of Q-values and neural network function approximator are key components of the state-of-the-art reinforcement learning (RL) algorithms, such as Soft Actor-Critic~\cite{haarnoja2018soft}.…

reinforcement-learning Reinforcement Learning (RL)

Wasserstein Adaptive Value Estimation for Actor-Critic Reinforcement Learning

2025-01-17 · Ali Baheri, Zahra Shahrooei, Chirayu Salgarkar

We present Wasserstein Adaptive Value Estimation for Actor-Critic (WAVE), an approach to enhance stability in deep reinforcement learning through adaptive Wasserstein regularization. Our method addresses the inherent ins…

Computational Efficiency Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Offline Reinforcement Learning with Soft Behavior Regularization

2021-10-14 · Haoran Xu, Xianyuan Zhan, Jianxiong Li, Honglei Yin

Most prior approaches to offline reinforcement learning (RL) utilize \textit{behavior regularization}, typically augmenting existing off-policy actor critic algorithms with a penalty measuring divergence between the poli…

continuous-control Continuous Control reinforcement-learning Reinforcement Learning+1

Policy Optimization Reinforcement Learning with Entropy Regularization

2019-12-02 · Jingbin Liu, Xinyang Gu, Shuai Liu

Entropy regularization is an important idea in reinforcement learning, with great success in recent algorithms like Soft Q Network (SQN) and Soft Actor-Critic (SAC1). In this work, we extend this idea into the on-policy …

Continuous Control reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Comparative Analysis of Parameterized Action Actor-Critic Reinforcement Learning Algorithms for Web Search Match Plan Generation

2025-10-03 · Ubayd Bapoo, Clement N Nyirenda arxiv

This study evaluates the performance of Soft Actor Critic (SAC), Greedy Actor Critic (GAC), and Truncated Quantile Critics (TQC) in high-dimensional decision-making tasks using fully observable environments. The focus is…

Hyperparameter Optimization Reinforcement Learning