paper-with-me

홈 › Papers

Watch, Try, Learn: Meta-Learning from Demonstrations and Reward

2019-06-07 · Allan Zhou, Eric Jang, Daniel Kappler, Alex Herzog, Mohi Khansari, Paul Wohlhart, Yunfei Bai, Mrinal Kalakrishnan, Sergey Levine, Chelsea Finn

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards enabling agents to learn a new task from one or a few demonstrations by leveraging experience from learning similar tasks. In the presence of task ambiguity or unobserved dynamics, demonstrations alone may not provide enough information; an agent must also try the task to successfully infer a policy. In this work, we propose a method that can learn to learn from both demonstrations and trial-and-error experience with sparse reward feedback. In comparison to meta-imitation, this approach enables the agent to effectively and efficiently improve itself autonomously beyond the demonstration data. In comparison to meta-reinforcement learning, we can scale to substantially broader distributions of tasks, as the demonstration reduces the burden of exploration. Our experiments show that our method significantly outperforms prior approaches on a set of challenging, vision-based control tasks.

📄 PDF Abstract BibTeX arXiv:1906.03352

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningMeta-LearningMeta Reinforcement LearningReinforcement Learning

Similar Papers 제목 키워드 기반

Watch, Try, Learn: Meta-Learning from Demonstrations and Rewards

2020-05-01 · ICLR 2020 1 · Allan Zhou, Eric Jang, Daniel Kappler, Alex Herzog 외

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising a…

Imitation LearningMeta-LearningMeta Reinforcement Learning

Meta-Imitation Learning by Watching Video Demonstrations

2021-09-29 · ICLR 2022 4 · Jiayi Li, Tao Lu, Xiaoge Cao, Yinghao Cai 외

Meta-Imitation Learning is a promising technique for the robot to learn a new task from observing one or a few human demonstrations. However, it usually requires a significant number of demonstrations both from humans an…

Imitation Learning

Watch and Match: Supercharging Imitation with Regularized Optimal Transport

2022-06-30 · Siddhant Haldar, Vaibhav Mathur, Denis Yarats, Lerrel Pinto

Imitation learning holds tremendous promise in learning policies efficiently for complex decision making problems. Current state-of-the-art algorithms often use inverse reinforcement learning (IRL), where given a set of …

Decision MakingImitation Learning

Extrapolating Beyond Suboptimal Demonstrations via Inverse Reinforcement Learning from Observations

2019-04-12 · Daniel S. Brown, Wonjoon Goo, Prabhat Nagarajan, Scott Niekum

A critical flaw of existing inverse reinforcement learning (IRL) methods is their inability to significantly outperform the demonstrator. This is because IRL typically seeks a reward function that makes the demonstrator …

Deep Reinforcement LearningImitation LearningMuJoCoreinforcement-learning+2

Learning Object Manipulation Skills via Approximate State Estimation from Real Videos

2020-11-13 · Vladimír Petrík, Makarand Tapaswi, Ivan Laptev, Josef Sivic

Humans are adept at learning new tasks by watching a few instructional videos. On the other hand, robots that learn new actions either require a lot of effort through trial and error, or use expert demonstrations that ar…

ObjectState Estimation