A State Representation Dueling Network for Deep Reinforcement Learning

2020-12-24 · Haomin Qiu, Feng Liu

In recent years there have been many successes in boosting the performance of Deep Q-Networks (DQN). Dueling DQN uses simple dueling architecture but significantly improves the performance of DQN [1]. However, Dueling DQN is only concerned about dueling in estimating Q-values. In this paper, we introduce a state representation dueling network, which provides an auxiliary task designed to be combined with other reinforcement learning algorithms to improve the performance of Deep RL. The state representation dueling network is designed to be beneficial for solving reinforcement learning tasks with high dimensional observation, such as camera input. The experiment shows that adding the state representation dueling network to Dueling DQN improves both the training speed and performance of Dueling DQN in CartPole environment.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningGeneral Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Double Q-learning Double Q-learning is an off-policy reinforcement learning algorithm that utilises double estimation to counteract overestimation problems with traditional Q-learning. The…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Dueling Network A Dueling Network is a type of Q-Network that has two streams to separately estimate (scalar) state-value and the advantages for each action. Both streams share a common…

(TravEL!!Guide)How Do I File a Claim with Expedia? How Do I File a Claim with Expedia? Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Fast Help & Exclusive Travel Discounts!Need to file a claim with…

Tanh Activation 설명 없음

Dueling Network Architectures for Deep Reinforcement Learning

2015-11-20 · Ziyu Wang, Tom Schaul, Matteo Hessel, Hado van Hasselt 외

In recent years there have been many successes of using deep representations in reinforcement learning. Still, many of these applications use conventional architectures, such as convolutional networks, LSTMs, or auto-enc…

Atari Games Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Maximum Entropy Dueling Network Architecture in Atari Domain

2021-07-30 · Alireza Nadali, Mohammad Mehdi Ebadzadeh

In recent years, there have been many deep structures for Reinforcement Learning, mainly for value function estimation and representations. These methods achieved great success in Atari 2600 domain. In this paper, we pro…

reinforcement-learning Reinforcement Learning (RL)

QPLEX: Duplex Dueling Multi-Agent Q-Learning

2020-08-03 · ICLR 2021 1 · Jianhao Wang, Zhizhou Ren, Terry Liu, Yang Yu 외

We explore value-based multi-agent reinforcement learning (MARL) in the popular paradigm of centralized training with decentralized execution (CTDE). CTDE has an important concept, Individual-Global-Max (IGM) principle, …

Decision Making Multi-agent Reinforcement Learning Q-Learning Starcraft+1

KLUCB Approach to Copeland Bandits

2019-02-07 · Nischal Agrawal, Prasanna Chaporkar

Multi-armed bandit(MAB) problem is a reinforcement learning framework where an agent tries to maximise her profit by proper selection of actions through absolute feedback for each action. The dueling bandits problem is a…

Information Retrieval Reinforcement Learning Retrieval Thompson Sampling

Spectral Analysis of Dueling Q-Learning

2026-07-09 · Donghwan Lee arxiv

Q-learning is a fundamental algorithm in reinforcement learning (RL) for solving discounted Markov decision processes (MDPs) when the transition kernel is unknown. The deep Q-network (DQN) extends Q-learning by using a d…

Reinforcement Learning