Interactive Imitation Learning in State-Space
Imitation Learning techniques enable programming the behavior of agents through demonstrations rather than manual engineering. However, they are limited by the quality of available demonstration data. Interactive Imitation Learning techniques can improve the efficacy of learning since they involve teachers providing feedback while the agent executes its task. In this work, we propose a novel Interactive Learning technique that uses human feedback in state-space to train and improve agent behavior (as opposed to alternative methods that use feedback in action-space). Our method titled Teaching Imitative Policies in State-space~(TIPS) enables providing guidance to the agent in terms of `changing its state' which is often more intuitive for a human demonstrator. Through continuous improvement via corrective feedback, agents trained by non-expert demonstrators using TIPS outperformed the demonstrator and conventional Imitation Learning agents.
Code (1)
Tasks
Imitation LearningSimilar Papers 제목 키워드 기반
Structured Imitation Learning of Interactive Policies through Inverse Games
Generative model-based imitation learning methods have recently achieved strong results in learning high-complexity motor skills from human demonstrations. However, imitation learning of interactive policies that coordin…
Inter3D: A Benchmark and Strong Baseline for Human-Interactive 3D Object Reconstruction
Recent advancements in implicit 3D reconstruction methods, e.g., neural rendering fields and Gaussian splatting, have primarily focused on novel view synthesis of static or dynamic objects with continuous motion states. …
3D Object Reconstruction3D ReconstructionNeural RenderingNovel View Synthesis+1A GAN-Like Approach for Physics-Based Imitation Learning and Interactive Character Control
We present a simple and intuitive approach for interactive control of physically simulated characters. Our work builds upon generative adversarial networks (GAN) and reinforcement learning, and introduces an imitation le…
Imitation LearningMotion GenerationA Note on Sample Complexity of Interactive Imitation Learning with Log Loss
Imitation learning (IL) is a general paradigm for learning from experts in sequential decision-making problems. Recent advancements in IL have shown that offline imitation learning, specifically Behavior Cloning (BC) wit…
Decision MakingImitation LearningSequential Decision MakingAccelerating Interactive Human-like Manipulation Learning with GPU-based Simulation and High-quality Demonstrations
Dexterous manipulation with anthropomorphic robot hands remains a challenging problem in robotics because of the high-dimensional state and action spaces and complex contacts. Nevertheless, skillful closed-loop manipulat…
GPUImitation LearningReinforcement Learning (RL)