Real-time Simultaneous Multi-Object 3D Shape Reconstruction, 6DoF Pose Estimation and Dense Grasp Prediction
Robotic manipulation systems operating in complex environments rely on perception systems that provide information about the geometry (pose and 3D shape) of the objects in the scene along with other semantic information such as object labels. This information is then used for choosing the feasible grasps on relevant objects. In this paper, we present a novel method to provide this geometric and semantic information of all objects in the scene as well as feasible grasps on those objects simultaneously. The main advantage of our method is its speed as it avoids sequential perception and grasp planning steps. With detailed quantitative analysis, we show that our method delivers competitive performance compared to the state-of-the-art dedicated methods for object shape, pose, and grasp predictions while providing fast inference at 30 frames per second speed.
Code (1)
Tasks
3D Shape ReconstructionObjectPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Co-Fusion: Real-time Segmentation, Tracking and Fusion of Multiple Objects
In this paper we introduce Co-Fusion, a dense SLAM system that takes a live stream of RGB-D images as input and segments the scene into different objects (using either motion or semantic cues) while simultaneously tracki…
Instance SegmentationObjectObject SLAMSemantic SLAM+1PoseFusion2: Simultaneous Background Reconstruction and Human Shape Recovery in Real-time
Dynamic environments that include unstructured moving objects pose a hard problem for Simultaneous Localization and Mapping (SLAM) performance. The motion of rigid objects can be typically tracked by exploiting their tex…
Pose EstimationSimultaneous Localization and MappingCenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimation
This paper studies the complex task of simultaneous multi-object 3D reconstruction, 6D pose and size estimation from a single-view RGB-D observation. In contrast to instance-level pose estimation, we focus on a more chal…
3D Reconstruction3D Shape Reconstruction6D Pose Estimation6D Pose Estimation using RGBD+2Real-time Simultaneous Pose and Shape Estimation for Articulated Objects Using a Single Depth Camera
In this paper we present a novel real-time algorithm for simultaneous pose and shape estimation for articulated objects, such as human beings and animals. The key of our pose estimation component is to embed the articula…
Pose EstimationBeyond 'Templates': Category-Agnostic Object Pose, Size, and Shape Estimation from a Single View
Estimating an object's 6D pose, size, and shape from visual input is a fundamental problem in computer vision, with critical applications in robotic grasping and manipulation. Existing methods either rely on object-speci…
Zero-shot GeneralizationRobotic GraspingPoint Clouds