Simulation-based Bayesian inference for multi-fingered robotic grasping
Multi-fingered robotic grasping is an undeniable stepping stone to universal picking and dexterous manipulation. Yet, multi-fingered grippers remain challenging to control because of their rich nonsmooth contact dynamics or because of sensor noise. In this work, we aim to plan hand configurations by performing Bayesian posterior inference through the full stochastic forward simulation of the robot in its environment, hence robustly accounting for many of the uncertainties in the system. While previous methods either relied on simplified surrogates of the likelihood function or attempted to learn to directly predict maximum likelihood estimates, we bring a novel simulation-based approach for full Bayesian inference based on a deep neural network surrogate of the likelihood-to-evidence ratio. Hand configurations are found by directly optimizing through the resulting amortized and differentiable expression for the posterior. The geometry of the configuration space is accounted for by proposing a Riemannian manifold optimization procedure through the neural posterior. Simulation and physical benchmarks demonstrate the high success rate of the procedure.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceRobotic GraspingSimilar Papers 제목 키워드 기반
DMFC-GraspNet: Differentiable Multi-Fingered Robotic Grasp Generation in Cluttered Scenes
Robotic grasping is a fundamental skill required for object manipulation in robotics. Multi-fingered robotic hands, which mimic the structure of the human hand, can potentially perform complex object manipulation. Nevert…
Computational EfficiencyGrasp GenerationMuJoCoRobotic GraspingFFHNet : Generating Multi-Fingered Robotic Grasps for Unknown Objects in Real-time
Grasping unknown objects with multi-fingered hands at high success rates and in real-time is an unsolved problem. Existing methods are limited in the speed of grasp synthesis or the ability to synthesize a variety of gra…
GPUGrasp GenerationUniGrasp: Learning a Unified Model to Grasp with Multifingered Robotic Hands
To achieve a successful grasp, gripper attributes such as its geometry and kinematics play a role as important as the object geometry. The majority of previous work has focused on developing grasp methods that generalize…
ObjectvalidPixel-Attentive Policy Gradient for Multi-Fingered Grasping in Cluttered Scenes
Recent advances in on-policy reinforcement learning (RL) methods enabled learning agents in virtual environments to master complex tasks with high-dimensional and continuous observation and action spaces. However, levera…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Robotic GraspingDexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost
Dexterous multi-fingered robotic hands can perform a wide range of manipulation skills, making them an appealing component for general-purpose robotic manipulators. However, such hands pose a major challenge for autonomo…
Contact-rich ManipulationDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1