SQT -- std $Q$-target

2024-02-03 · Nitsan Soffair, Dotan Di-Castro, Orly Avner, Shie Mannor

Std $Q$-target is a conservative, actor-critic, ensemble, $Q$-learning-based algorithm, which is based on a single key $Q$-formula: $Q$-networks standard deviation, which is an "uncertainty penalty", and, serves as a minimalistic solution to the problem of overestimation bias. We implement SQT on top of TD3/TD7 code and test it against the state-of-the-art (SOTA) actor-critic algorithms, DDPG, TD3 and TD7 on seven popular MuJoCo and Bullet tasks. Our results demonstrate SQT's $Q$-target formula superiority over TD3's $Q$-target formula as a conservative solution to overestimation bias in RL, while SQT shows a clear performance advantage on a wide margin over DDPG, TD3, and TD7 on all tasks.

📄 PDF Abstract BibTeX arXiv:2402.05950

Code (0)

등록된 구현이 없습니다.

Tasks

MuJoCoQ-Learning

Methods 이 논문이 사용한 방법론

Target Policy Smoothing Target Policy Smoothing is a regularization strategy for the value function in reinforcement learning. Deterministic policies can overfit to narrow peaks in the value…

Clipped Double Q-learning 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Batch Normalization 설명 없음

TD3 TD3 builds on the DDPG algorithm for reinforcement learning, with a couple of modifications aimed at tackling overestimation bias…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Weight Decay 설명 없음

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

NP-TCMtarget: a network pharmacology platform for exploring mechanisms of action of Traditional Chinese medicine

2024-08-17 · Aoyi Wang, Yingdong Wang, Haoyang Peng, Haoran Zhang 외

The biological targets of traditional Chinese medicine (TCM) are the core effectors mediating the interaction between TCM and the human body. Identification of TCM targets is essential to elucidate the chemical basis and…

Binary Classification

End-to-End Joint Target and Non-Target Speakers ASR

2023-06-04 · Ryo Masumura, Naoki Makishima, Taiga Yamane, Yoshihiko Yamazaki 외

This paper proposes a novel automatic speech recognition (ASR) system that can transcribe individual speaker's speech while identifying whether they are target or non-target speakers from multi-talker overlapped speech. …

Automatic Speech Recognition Automatic Speech Recognition (ASR)speech-recognition Speech Recognition

TDParse: Multi-target-specific sentiment recognition on Twitter

2017-04-01 · EACL 2017 4 · Bo Wang, Maria Liakata, Arkaitz Zubiaga, Rob Procter

Existing target-specific sentiment recognition methods consider only a single target per tweet, and have been shown to miss nearly half of the actual targets mentioned. We present a corpus of UK election tweets, with an …

Dependency Parsing Opinion Mining Sentiment Analysis Twitter Sentiment Analysis

Multiple Instance Hybrid Estimator for Hyperspectral Target Characterization and Sub-pixel Target Detection

2017-10-31 · Changzhe Jiao, Chao Chen, Ronald G. McGarvey, Stephanie Bohlman 외

The Multiple Instance Hybrid Estimator for discriminative target characterization from imprecisely labeled hyperspectral data is presented. In many hyperspectral target detection problems, acquiring accurately labeled tr…

Multiple Instance Learning

The impact of non-target events in synthetic soundscapes for sound event detection

2021-09-28 · Francesca Ronchini, Romain Serizel, Nicolas Turpault, Samuele Cornell

Detection and Classification Acoustic Scene and Events Challenge 2021 Task 4 uses a heterogeneous dataset that includes both recorded and synthetic soundscapes. Until recently only target sound events were considered whe…

Event Detection Sound Event Detection