MATCH POLICY: A Simple Pipeline from Point Cloud Registration to Manipulation Policies
Many manipulation tasks require the robot to rearrange objects relative to one another. Such tasks can be described as a sequence of relative poses between parts of a set of rigid bodies. In this work, we propose MATCH POLICY, a simple but novel pipeline for solving high-precision pick and place tasks. Instead of predicting actions directly, our method registers the pick and place targets to the stored demonstrations. This transfers action inference into a point cloud registration task and enables us to realize nontrivial manipulation policies without any training. MATCH POLICY is designed to solve high-precision tasks with a key-frame setting. By leveraging the geometric interaction and the symmetries of the task, it achieves extremely high sample efficiency and generalizability to unseen configurations. We demonstrate its state-of-the-art performance across various tasks on RLBench benchmark compared with several strong baselines and test it on a real robot with six tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Point Cloud RegistrationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Graphite: GRAPH-Induced feaTure Extraction for Point Cloud Registration
3D Point clouds are a rich source of information that enjoy growing popularity in the vision community. However, due to the sparsity of their representation, learning models based on large point clouds is still a challen…
DescriptiveKeypoint DetectionMetric LearningPoint Cloud Registration+1Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learning
In robot learning, the observation space is crucial due to the distinct characteristics of different modalities, which can potentially become a bottleneck alongside policy design. In this study, we explore the influence …
Contact-rich ManipulationZero-shot GeneralizationExploring Simple 3D Multi-Object Tracking for Autonomous Driving
3D multi-object tracking in LiDAR point clouds is a key ingredient for self-driving vehicles. Existing methods are predominantly based on the tracking-by-detection pipeline and inevitably require a heuristic matching ste…
3D Multi-Object TrackingAutonomous DrivingMotion EstimationMulti-Object Tracking+4PICCOLO: Point Cloud-Centric Omnidirectional Localization
We present PICCOLO, a simple and efficient algorithm for omnidirectional localization. Given a colored point cloud and a 360 panorama image of a scene, our objective is to recover the camera pose at which the panorama im…
Visual LocalizationGS-Matching: Reconsidering Feature Matching task in Point Cloud Registration
Traditional point cloud registration (PCR) methods for feature matching often employ the nearest neighbor policy. This leads to many-to-one matches and numerous potential inliers without any corresponding point. Recently…
Point Cloud Registration