Automatic Trade-off Adaptation in Offline RL
Recently, offline RL algorithms have been proposed that remain adaptive at runtime. For example, the LION algorithm \cite{lion} provides the user with an interface to set the trade-off between behavior cloning and optimality w.r.t. the estimated return at runtime. Experts can then use this interface to adapt the policy behavior according to their preferences and find a good trade-off between conservatism and performance optimization. Since expert time is precious, we extend the methodology with an autopilot that automatically finds the correct parameterization of the trade-off, yielding a new algorithm which we term AutoLION.
Code (0)
등록된 구현이 없습니다.
Tasks
Offline RLMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Constrained Decision Transformer for Offline Safe Reinforcement Learning
Safe reinforcement learning (RL) trains a constraint satisfaction policy by interacting with the environment. We aim to tackle a more challenging problem: learning a safe policy from an offline dataset. We study the offl…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Safe Reinforcement LearningDomain Adaptation for Offline Reinforcement Learning with Limited Samples
Offline reinforcement learning (RL) learns effective policies from a static target dataset. Despite state-of-the-art (SOTA) offline RL algorithms being promising, they highly rely on the quality of the target dataset. Th…
Domain AdaptationOffline RLreinforcement-learningReinforcement Learning+1Does Simultaneous Speech Translation need Simultaneous Models?
In simultaneous speech translation (SimulST), finding the best trade-off between high translation quality and low latency is a challenging task. To meet the latency constraints posed by the different application scenario…
TranslationSelf-adapting Robotic Agents through Online Continual Reinforcement Learning with World Model Feedback
As learning-based robotic controllers are typically trained offline and deployed with fixed parameters, their ability to cope with unforeseen changes during operation is limited. Biologically inspired, this work presents…
Reinforcement LearningContinuous ControlData-Driven Offline Decision-Making via Invariant Representation Learning
The goal in offline data-driven decision-making is synthesize decisions that optimize a black-box utility function, using a previously-collected static dataset, with no active interaction. These problems appear in many f…
Decision MakingDomain AdaptationReinforcement Learning (RL)Representation Learning