PAC Reinforcement Learning without Real-World Feedback

2019-09-23 · Yuren Zhong, Aniket Anand Deshmukh, Clayton Scott

This work studies reinforcement learning in the Sim-to-Real setting, in which an agent is first trained on a number of simulators before being deployed in the real world, with the aim of decreasing the real-world sample complexity requirement. Using a dynamic model known as a rich observation Markov decision process (ROMDP), we formulate a theoretical framework for Sim-to-Real in the situation where feedback in the real world is not available. We establish real-world sample complexity guarantees that are smaller than what is currently known for directly (i.e., without access to simulators) learning a ROMDP with feedback.

📄 PDF Abstract BibTeX arXiv:1909.10449

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Autonomous Robotic Reinforcement Learning with Asynchronous Human Feedback

2023-10-31 · Max Balsells, Marcel Torne, Zihan Wang, Samedh Desai 외

Ideally, we would place a robot in a real-world environment and leave it there improving on its own by gathering more experience autonomously. However, algorithms for autonomous robotic learning have been challenging to …

reinforcement-learning Reinforcement Learning Self-Supervised Learning

Selective Progress-Aware Querying for Human-in-the-Loop Reinforcement Learning

2025-09-24 · Anujith Muraleedharan, Anamika J H arxiv

Human feedback can greatly accelerate robot learning, but in real-world settings, such feedback is costly and limited. Existing human-in-the-loop reinforcement learning (HiL-RL) methods often assume abundant feedback, li…

Reinforcement Learning

Breadcrumbs to the Goal: Goal-Conditioned Exploration from Human-in-the-Loop Feedback

2023-07-20 · Marcel Torne, Max Balsells, Zihan Wang, Samedh Desai 외

Exploration and reward specification are fundamental and intertwined challenges for reinforcement learning. Solving sequential decision-making tasks requiring expansive exploration requires either careful design of rewar…

Decision Making reinforcement-learning Reinforcement Learning Self-Supervised Learning+1

A General Offline Reinforcement Learning Framework for Interactive Recommendation

2023-10-01 · Teng Xiao, Donglin Wang

This paper studies the problem of learning interactive recommender systems from logged feedbacks without any exploration in online environments. We address the problem by proposing a general offline reinforcement learnin…

Interactive Recommendation Recommendation Systems reinforcement-learning Reinforcement Learning

On the Theory of Reinforcement Learning with Once-per-Episode Feedback

2021-05-29 · NeurIPS 2021 12 · Niladri S. Chatterji, Aldo Pacchiano, Peter L. Bartlett, Michael I. Jordan

We study a theory of reinforcement learning (RL) in which the learner receives binary feedback only once at the end of an episode. While this is an extreme test case for theory, it is also arguably more representative of…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Self-Driving Cars