A Strategy-Oriented Bayesian Soft Actor-Critic Model

2023-03-07 · Qin Yang, Ramviyas Parasuraman

Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system's utility, decrease the overall cost, and increase mission success probability. This paper proposes a novel hierarchical strategy decomposition approach based on the Bayesian chain rule to separate an intricate policy into several simple sub-policies and organize their relationships as Bayesian strategy networks (BSN). We integrate this approach into the state-of-the-art DRL method -- soft actor-critic (SAC) and build the corresponding Bayesian soft actor-critic (BSAC) model by organizing several sub-policies as a joint policy. We compare the proposed BSAC method with the SAC and other state-of-the-art approaches such as TD3, DDPG, and PPO on the standard continuous control benchmarks -- Hopper-v2, Walker2d-v2, and Humanoid-v2 -- in MuJoCo with the OpenAI Gym environment. The results demonstrate that the promising potential of the BSAC method significantly improves training efficiency.

📄 PDF Abstract BibTeX arXiv:2303.04193

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-control Continuous ControlMuJoCoOpenAI Gym

Methods 이 논문이 사용한 방법론

Weight Decay 설명 없음

Clipped Double Q-learning 설명 없음

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Batch Normalization 설명 없음

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Dilated Convolution 설명 없음

Entropy Regularization 설명 없음

Bayesian Soft Actor-Critic: A Directed Acyclic Strategy Graph Based Deep Reinforcement Learning

2022-08-11 · Qin Yang, Ramviyas Parasuraman

continuous-control Continuous Control Deep Reinforcement Learning OpenAI Gym+2

PAC-Bayesian Soft Actor-Critic Learning

2023-01-30 · Bahareh Tasdighi, Abdullah Akgül, Manuel Haussmann, Kenny Kazimirzak Brink 외

Actor-critic algorithms address the dual goals of reinforcement learning (RL), policy evaluation and improvement via two separate function approximators. The practicality of this approach comes at the expense of training…

Reinforcement Learning (RL)

Re-ENACT: Reinforcement Learning for Emotional Speech Generation using Actor-Critic Strategy

2024-08-04 · Ravi Shankar, Archana Venkataraman

In this paper, we propose the first method to modify the prosodic features of a given speech signal using actor-critic reinforcement learning strategy. Our approach uses a Bayesian framework to identify contiguous segmen…

reinforcement-learning Reinforcement Learning Rhythm

Hyper-parameter optimization based on soft actor critic and hierarchical mixture regularization

2021-12-08 · Chaoyue Liu, Yulai Zhang

Hyper-parameter optimization is a crucial problem in machine learning as it aims to achieve the state-of-the-art performance in any model. Great efforts have been made in this field, such as random search, grid search, B…

Bayesian Optimization reinforcement-learning Reinforcement Learning (RL)

CTSAC: Curriculum-Based Transformer Soft Actor-Critic for Goal-Oriented Robot Exploration

2025-03-18 · Chunyu Yang, Shengben Bi, Yihui Xu, Xin Zhang

With the increasing demand for efficient and flexible robotic exploration solutions, Reinforcement Learning (RL) is becoming a promising approach in the field of autonomous robotic exploration. However, current RL-based …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)