Soft Actor-Critic With Integer Actions

2021-09-17 · Ting-Han Fan, YuBo Wang

Reinforcement learning is well-studied under discrete actions. Integer actions setting is popular in the industry yet still challenging due to its high dimensionality. To this end, we study reinforcement learning under integer actions by incorporating the Soft Actor-Critic (SAC) algorithm with an integer reparameterization. Our key observation for integer actions is that their discrete structure can be simplified using their comparability property. Hence, the proposed integer reparameterization does not need one-hot encoding and is of low dimensionality. Experiments show that the proposed SAC under integer actions is as good as the continuous action version on robot control tasks and outperforms Proximal Policy Optimization on power distribution systems control tasks.

📄 PDF Abstract BibTeX arXiv:2109.08512

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음

Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Dilated Convolution 설명 없음

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

SAC 설명 없음

Variational Quantum Soft Actor-Critic

2021-12-20 · Qingfeng Lan

Quantum computing has a superior advantage in tackling specific problems, such as integer factorization and Simon's problem. For more general tasks in machine learning, by applying variational quantum circuits, more and …

continuous-control Continuous Control reinforcement-learning Reinforcement Learning+1

Soft Actor-Critic for Discrete Action Settings

2019-10-16 · Petros Christodoulou

Soft Actor-Critic is a state-of-the-art reinforcement learning algorithm for continuous action settings that is not applicable to discrete action settings. Many important settings involve discrete actions, however, and s…

Atari Games reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement Learning for Mixed-Integer Problems Based on MPC

2020-04-03 · Sebastien Gros, Mario Zanon

Model Predictive Control has been recently proposed as policy approximation for Reinforcement Learning, offering a path towards safe and explainable Reinforcement Learning. This approach has been investigated for Q-learn…

Model Predictive Control Q-Learning reinforcement-learning Reinforcement Learning+1

Corrected Soft Actor Critic for Continuous Control

2024-10-22 · Yanjun Chen, Xinming Zhang, Xianghui Wang, Zhiqiang Xu 외

The Soft Actor-Critic (SAC) algorithm is known for its stability and high sample efficiency in deep reinforcement learning. However, the tanh transformation applied to sampled actions in SAC distorts the action distribut…

continuous-control Continuous Control Deep Reinforcement Learning

Greedy Actor-Critic: A New Conditional Cross-Entropy Method for Policy Improvement

2018-10-22 · Samuel Neumann, Sungsu Lim, Ajin Joseph, Yangchen Pan 외

Many policy gradient methods are variants of Actor-Critic (AC), where a value function (critic) is learned to facilitate updating the parameterized policy (actor). The update to the actor involves a log-likelihood update…

Policy Gradient Methods Q-Learning