Learning to Predict Robot Keypoints Using Artificially Generated Images
This work considers robot keypoint estimation on color images as a supervised machine learning task. We propose the use of probabilistically created renderings to overcome the lack of labeled real images. Rather than sampling from stationary distributions, our approach introduces a feedback mechanism that constantly adapts probability distributions according to current training progress. Initial results show, our approach achieves near-human-level accuracy on real images. Additionally, we demonstrate that feedback leads to fewer required training steps, while maintaining the same model quality on synthetic data sets.
Code (1)
Tasks
BIG-bench Machine LearningKeypoint EstimationSimilar Papers 제목 키워드 기반
End-to-end Reinforcement Learning of Robotic Manipulation with Robust Keypoints Representation
We present an end-to-end Reinforcement Learning(RL) framework for robotic manipulation tasks, using a robust and efficient keypoints representation. The proposed method learns keypoints from camera images as the state re…
reinforcement-learningReinforcement Learning (RL)Keypoint Abstraction using Large Models for Object-Relative Imitation Learning
Generalization to novel object configurations and instances across diverse tasks and environments is a critical challenge in robotics. Keypoint-based representations have been proven effective as a succinct representatio…
Imitation LearningObject6D Object Pose Estimation using Keypoints and Part Affinity Fields
The task of 6D object pose estimation from RGB images is an important requirement for autonomous service robots to be able to interact with the real world. In this work, we present a two-step pipeline for estimating the …
6D Pose Estimation using RGBObjectPose EstimationTranslationUnsupervised Learning of Visual 3D Keypoints for Control
Learning sensorimotor control policies from high-dimensional images crucially relies on the quality of the underlying visual representations. Prior works show that structured latent space such as visual keypoints often o…
Clone Swarms: Learning to Predict and Control Multi-Robot Systems by Imitation
In this paper, we propose SwarmNet -- a neural network architecture that can learn to predict and imitate the behavior of an observed swarm of agents in a centralized manner. Tested on artificially generated swarm motion…