Reinforcement Learning using Augmented Neural Networks

2018-06-20 · Jack Shannon, Marek Grzes

Neural networks allow Q-learning reinforcement learning agents such as deep Q-networks (DQN) to approximate complex mappings from state spaces to value functions. However, this also brings drawbacks when compared to other function approximators such as tile coding or their generalisations, radial basis functions (RBF) because they introduce instability due to the side effect of globalised updates present in neural networks. This instability does not even vanish in neural networks that do not have any hidden layers. In this paper, we show that simple modifications to the structure of the neural network can improve stability of DQN learning when a multi-layer perceptron is used for function approximation.

📄 PDF Abstract BibTeX arXiv:1806.07692

Code (0)

등록된 구현이 없습니다.

Tasks

Q-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

A New Concept of Deep Reinforcement Learning based Augmented General Tagging System

2018-08-01 · COLING 2018 8 · Yu Wang, Abhishek Patel, Hongxia Jin

In this paper, a new deep reinforcement learning based augmented general tagging system is proposed. The new system contains two parts: a deep neural network (DNN) based sequence labeling model and a deep reinforcement l…

Deep Reinforcement Learning Named Entity Recognition (NER)reinforcement-learning Reinforcement Learning+3

A New Concept of Deep Reinforcement Learning based Augmented General Sequence Tagging System

2018-12-26 · Yu Wang, Abhishek Patel, Hongxia Jin

In this paper, a new deep reinforcement learning based augmented general sequence tagging system is proposed. The new system contains two parts: a deep neural network (DNN) based sequence tagging model and a deep reinfor…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

MMRAG-RFT: Two-stage Reinforcement Fine-tuning for Explainable Multi-modal Retrieval-augmented Generation

2025-12-19 · Shengwei Zhao, Jingwen Yao, Sitong Wei, Linhai Xu 외 arxiv

Multi-modal Retrieval-Augmented Generation (MMRAG) enables highly credible generation by integrating external multi-modal knowledge, thus demonstrating impressive performance in complex multi-modal scenarios. However, ex…

Reinforcement Learning Response Generation Answer Generation

Augmented Q Imitation Learning (AQIL)

2020-03-31 · Xiao Lei Zhang, Anish Agarwal

The study of unsupervised learning can be generally divided into two categories: imitation learning and reinforcement learning. In imitation learning the machine learns by mimicking the behavior of an expert system where…

Deep Reinforcement Learning Imitation Learning Q-Learning reinforcement-learning+2

Imagination-Augmented Agents for Deep Reinforcement Learning

2017-07-19 · NeurIPS 2017 12 · Théophane Weber, Sébastien Racanière, David P. Reichert, Lars Buesing 외

We introduce Imagination-Augmented Agents (I2As), a novel architecture for deep reinforcement learning combining model-free and model-based aspects. In contrast to most existing model-based reinforcement learning and pla…

Deep Reinforcement Learning Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning+1