Deep Radial-Basis Value Functions for Continuous Control

2020-02-05 · Kavosh Asadi, Neev Parikh, Ronald E. Parr, George D. Konidaris, Michael L. Littman

A core operation in reinforcement learning (RL) is finding an action that is optimal with respect to a learned value function. This operation is often challenging when the learned value function takes continuous actions as input. We introduce deep radial-basis value functions (RBVFs): value functions learned using a deep network with a radial-basis function (RBF) output layer. We show that the maximum action-value with respect to a deep RBVF can be approximated easily and accurately. Moreover, deep RBVFs can represent any true value function owing to their support for universal function approximation. We extend the standard DQN algorithm to continuous control by endowing the agent with a deep RBVF. We show that the resultant agent, called RBF-DQN, significantly outperforms value-function-only baselines, and is competitive with state-of-the-art actor-critic algorithms.

📄 PDF Abstract BibTeX arXiv:2002.01883

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-control Continuous Control Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Time Series Missing Imputation with Multivariate Radial Basis Function Neural Network

2024-07-24 · Chanyoung Jung, Yun Jang

Researchers have been persistently working to address the issue of missing values in time series data. Numerous models have been proposed, striving to estimate the distribution of the data. The Radial Basis Functions Neu…

Imputation Missing Values Time Series

Mixture Models for the Analysis, Edition, and Synthesis of Continuous Time Series

2021-04-21 · Sylvain Calinon

This chapter presents an overview of techniques used for the analysis, edition, and synthesis of time series, with a particular emphasis on motion data. The use of mixture models allows the decomposition of time signals …

Time Series Time Series Analysis

NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions

2023-09-27 · ICCV 2023 1 · Zhang Chen, Zhong Li, Liangchen Song, Lele Chen 외

We present a novel type of neural fields that uses general radial bases for signal representation. State-of-the-art neural fields typically rely on grid-based representations for storing local neural features and N-dimen…

Face Detection Using Radial Basis Functions Neural Networks With Fixed Spread

2014-08-07 · K. A. A. Aziz, S. S. Abdullah

This paper presented a face detection system using Radial Basis Function Neural Networks With Fixed Spread Value. Face detection is the first step in face recognition system. The purpose is to localize and extract the fa…

Face Detection Face Recognition

Cascaded Light Propagation Volumes using Spherical Radial Basis Functions

2024-07-24 · Ludovic Silvestre, João Pereira

This paper introduces a contribution made to one of the newest methods for simulating indirect lighting in dynamic scenes , the cascaded light propagation volumes . Our contribution consists on using Spherical Radial Bas…