TD3

2000년 도입 · 논문 117편에서 사용

TD3 builds on the DDPG algorithm for reinforcement learning, with a couple of modifications aimed at tackling overestimation bias with the value function. In particular, it utilises clipped double Q-learning, delayed update of target and policy networks, and target policy smoothing (which is similar to a SARSA based update; a safer update, as they provide higher value to actions resistant to perturbations).

출처: Addressing Function Approximation Error in Actor-Critic Methods

소개 논문: Addressing Function Approximation Error in Actor-Critic Methods