JENGA: Object selection and pose estimation for robotic grasping from a stack
Vision-based robotic object grasping is typically investigated in the context of isolated objects or unstructured object sets in bin picking scenarios. However, there are several settings, such as construction or warehouse automation, where a robot needs to interact with a structured object formation such as a stack. In this context, we define the problem of selecting suitable objects for grasping along with estimating an accurate 6DoF pose of these objects. To address this problem, we propose a camera-IMU based approach that prioritizes unobstructed objects on the higher layers of stacks and introduce a dataset for benchmarking and evaluation, along with a suitable evaluation metric that combines object selection with pose accuracy. Experimental results show that although our method can perform quite well, this is a challenging problem if a completely error-free solution is needed. Finally, we show results from the deployment of our method for a brick-picking application in a construction scenario.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingObjectPose EstimationRobotic GraspingSimilar Papers 제목 키워드 기반
Deep Instance Segmentation and Visual Servoing to Play Jenga with a Cost-Effective Robotic System
The game of Jenga represents an inspiring benchmark for developing innovative manipulation solutions for complex tasks. Indeed, it encouraged the study of novel robotics methods to successfully extract blocks from the to…
Instance SegmentationSemantic SegmentationVisual TrackingVisual Jenga: Discovering Object Dependencies via Counterfactual Inpainting
This paper proposes a novel scene understanding task called Visual Jenga. Drawing inspiration from the game Jenga, the proposed task involves progressively removing objects from a single image until only the background r…
counterfactualObjectScene UnderstandingTraining-Free Efficient Video Generation via Dynamic Token Carving
Despite the remarkable generation quality of video Diffusion Transformer (DiT) models, their practical deployment is severely hindered by extensive computational requirements. This inefficiency stems from two key challen…
DenoisingVideo GenerationJenGAN: Stacked Shifted Filters in GAN-Based Speech Synthesis
Non-autoregressive GAN-based neural vocoders are widely used due to their fast inference speed and high perceptual quality. However, they often suffer from audible artifacts such as tonal artifacts in their generated res…
Speech SynthesisJenga Stacking Based on 6D Pose Estimation for Architectural Form Finding Process
This paper includes a review of current state of the art 6d pose estimation methods, as well as a discussion of which pose estimation method should be used in two types of architectural design scenarios. Taking the lates…
6D Pose EstimationFormPose Estimation