paper-with-me

홈 › Papers

Entropy Augmented Reinforcement Learning

2022-08-19 · Jianfei Ma

Deep reinforcement learning was instigated with the presence of trust region methods, being scalable and efficient. However, the pessimism of such algorithms, among which it forces to constrain in a trust region by all means, has been proven to suppress the exploration and harm the performance. Exploratory algorithm such as SAC, while utilizes the entropy to encourage exploration, implicitly optimizing another objective yet. We first observed this inconsistency, and therefore put forward an analogous augmentation technique, which combines well with the on-policy algorithms, when a value critic is involved. Surprisingly, the proposed method consistently satisfies the soft policy improvement theorem, while being more extensible. As the analysis advises, it is crucial to control the temperature coefficient to balance the exploration and exploitation. Empirical tests on MuJoCo benchmark tasks show that the agent is heartened towards higher reward regions, and enjoys a finer performance. Furthermore, we verify the exploration bonus of our method on a set of custom environments.

📄 PDF Abstract BibTeX arXiv:2208.09322

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningMuJoCoreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Dilated Convolution 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Average Pooling 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
SAC 설명 없음
Entropy Regularization 설명 없음
TRPO Trust Region Policy Optimization, or TRPO, is a policy gradient method in reinforcement learning that avoids parameter updates that change the policy too much with a KL…

Similar Papers 제목 키워드 기반

Entropy-Augmented Entropy-Regularized Reinforcement Learning and a Continuous Path from Policy Gradient to Q-Learning

2020-05-18 · Donghoon Lee

Entropy augmented to reward is known to soften the greedy argmax policy to softmax policy. Entropy augmentation is reformulated and leads to a motivation to introduce an additional entropy term to the objective function …

Q-Learning

Diffusion-Augmented Markov Decision Processes for Maximum Entropy Reinforcement Learning

2025-12-01 · Sebastian Sanokowski, Kaustubh Patil arxiv

Diffusion models excel at sampling from complex, unnormalized distributions. In this work, we extend Maximum Entropy Reinforcement Learning (ME-RL) to diffusion processes, enabling sampling from the optimal policy trajec…

Reinforcement Learning

A Model-Based Approach for Improving Reinforcement Learning Efficiency Leveraging Expert Observations

2024-02-29 · Erhan Can Ozcan, Vittorio Giammarino, James Queeney, Ioannis Ch. Paschalidis

This paper investigates how to incorporate expert observations (without explicit information on expert actions) into a deep reinforcement learning setting to improve sample efficiency. First, we formulate an augmented po…

continuous-controlContinuous ControlDeep Reinforcement Learningreinforcement-learning+1

From Credit Assignment to Entropy Regularization: Two New Algorithms for Neural Sequence Prediction

2018-04-29 · ACL 2018 7 · Zihang Dai, Qizhe Xie, Eduard Hovy

In this work, we study the credit assignment problem in reward augmented maximum likelihood (RAML) learning, and establish a theoretical equivalence between the token-level counterpart of RAML and the entropy regularized…

Predictionreinforcement-learningReinforcement LearningReinforcement Learning (RL)

LODESTAR: Robust Entropy-Based Answer Selection in Retrieval-Augmented Generation for Question Answering -- Directing Frozen-LLM Entropy with a Reinforcement-Learned Prompt Polarizer under Misleading Passages

2026-08-12 · Hung-Chun Hsu, Po-Jen Ko, Che-Cheng Wu, Li-Yang Chang 외 arxiv

Predictive-distribution entropy is a strong answer-selection rule in retrieval-augmented generation (RAG) for question answering: across five QA benchmarks, selecting the answer a frozen respondent LLM produces with the …

Reinforcement LearningQuestion AnsweringAnswer Selection