3D Convolution on RGB-D Point Clouds for Accurate Model-free Object Pose Estimation
The conventional pose estimation of a 3D object usually requires the knowledge of the 3D model of the object. Even with the recent development in convolutional neural networks (CNNs), a 3D model is often necessary in the final estimation. In this paper, we propose a two-stage pipeline that takes in raw colored point cloud data and estimates an object's translation and rotation by running 3D convolutions on voxels. The pipeline is simple yet highly accurate: translation error is reduced to the voxel resolution (around 1 cm) and rotation error is around 5 degrees. The pipeline is also put to actual robotic grasping tests where it achieves above 90% success rate for test objects. Another innovation is that a motion capture system is used to automatically label the point cloud samples which makes it possible to rapidly collect a large amount of highly accurate real data for training the neural networks.
Code (0)
등록된 구현이 없습니다.
Tasks
Pose EstimationRobotic GraspingTranslationSimilar Papers 제목 키워드 기반
CG-SSD: Corner Guided Single Stage 3D Object Detection from LiDAR Point Cloud
At present, the anchor-based or anchor-free models that use LiDAR point clouds for 3D object detection use the center assigner strategy to infer the 3D bounding boxes. However, in a real world scene, the LiDAR can only a…
3D Object DetectionObjectobject-detectionObject DetectionAnchor-free 3D Single Stage Detector with Mask-Guided Attention for Point Cloud
Most of the existing single-stage and two-stage 3D object detectors are anchor-based methods, while the efficient but challenging anchor-free single-stage 3D object detection is not well investigated. Recent studies on 2…
2D Object Detection3D Object DetectionObjectobject-detection+1Pointwise Convolutional Neural Networks
Deep learning with 3D data such as reconstructed point clouds and CAD models has received great research interests recently. However, the capability of using point clouds with convolutional neural network has been so far…
ObjectObject RecognitionSegmentationSemantic SegmentationIPC-Net: 3D point-cloud segmentation using deep inter-point convolutional layers
Over the last decade, the demand for better segmentation and classification algorithms in 3D spaces has significantly grown due to the popularity of new 3D sensor technologies and advancements in the field of robotics. P…
Point Cloud SegmentationSCTN: Sparse Convolution-Transformer Network for Scene Flow Estimation
We propose a novel scene flow estimation approach to capture and infer 3D motions from point clouds. Estimating 3D motions for point clouds is challenging, since a point cloud is unordered and its density is significantl…
Scene Flow Estimation