paper-with-me

홈 › Papers

Watch, Try, Learn: Meta-Learning from Demonstrations and Rewards

2020-05-01 · ICLR 2020 1 · Allan Zhou, Eric Jang, Daniel Kappler, Alex Herzog, Mohi Khansari, Paul Wohlhart, Yunfei Bai, Mrinal Kalakrishnan, Sergey Levine, Chelsea Finn

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards enabling agents to learn a new task from one or a few demonstrations by leveraging experience from learning similar tasks. In the presence of task ambiguity or unobserved dynamics, demonstrations alone may not provide enough information; an agent must also try the task to successfully infer a policy. In this work, we propose a method that can learn to learn from both demonstrations and trial-and-error experience with sparse reward feedback. In comparison to meta-imitation, this approach enables the agent to effectively and efficiently improve itself autonomously beyond the demonstration data. In comparison to meta-reinforcement learning, we can scale to substantially broader distributions of tasks, as the demonstration reduces the burden of exploration. Our experiments show that our method significantly outperforms prior approaches on a set of challenging, vision-based control tasks.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningMeta-LearningMeta Reinforcement Learning

Similar Papers 제목 키워드 기반

Meta-Imitation Learning by Watching Video Demonstrations

2021-09-29 · ICLR 2022 4 · Jiayi Li, Tao Lu, Xiaoge Cao, Yinghao Cai 외

Meta-Imitation Learning is a promising technique for the robot to learn a new task from observing one or a few human demonstrations. However, it usually requires a significant number of demonstrations both from humans an…

Imitation Learning

Watch, Try, Learn: Meta-Learning from Demonstrations and Reward

2019-06-07 · Allan Zhou, Eric Jang, Daniel Kappler, Alex Herzog 외

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising a…

Imitation LearningMeta-LearningMeta Reinforcement LearningReinforcement Learning

Watch and Match: Supercharging Imitation with Regularized Optimal Transport

2022-06-30 · Siddhant Haldar, Vaibhav Mathur, Denis Yarats, Lerrel Pinto

Imitation learning holds tremendous promise in learning policies efficiently for complex decision making problems. Current state-of-the-art algorithms often use inverse reinforcement learning (IRL), where given a set of …

Decision MakingImitation Learning

Learning Object Manipulation Skills via Approximate State Estimation from Real Videos

2020-11-13 · Vladimír Petrík, Makarand Tapaswi, Ivan Laptev, Josef Sivic

Humans are adept at learning new tasks by watching a few instructional videos. On the other hand, robots that learn new actions either require a lot of effort through trial and error, or use expert demonstrations that ar…

ObjectState Estimation

Meta-Inverse Reinforcement Learning with Probabilistic Context Variables

2019-09-20 · NeurIPS 2019 12 · Lantao Yu, Tianhe Yu, Chelsea Finn, Stefano Ermon

Providing a suitable reward function to reinforcement learning can be difficult in many real world applications. While inverse reinforcement learning (IRL) holds promise for automatically learning reward functions from d…

continuous-controlContinuous Controlreinforcement-learningReinforcement Learning+1