paper-with-me

Papers

Registered and Segmented Deformable Object Reconstruction from a Single View Point Cloud

2023-11-13 · Pit Henrich, Balázs Gyenes, Paul Maria Scheikl, Gerhard Neumann, Franziska Mathis-Ullrich

In deformable object manipulation, we often want to interact with specific segments of an object that are only defined in non-deformed models of the object. We thus require a system that can recognize and locate these segments in sensor data of deformed real world objects. This is normally done using deformable object registration, which is problem specific and complex to tune. Recent methods utilize neural occupancy functions to improve deformable object registration by registering to an object reconstruction. Going one step further, we propose a system that in addition to reconstruction learns segmentation of the reconstructed object. As the resulting output already contains the information about the segments, we can skip the registration process. Tested on a variety of deformable objects in simulation and the real world, we demonstrate that our method learns to robustly find these segments. We also introduce a simple sampling algorithm to generate better training data for occupancy learning.

📄 PDF Abstract BibTeX arXiv:2311.07357

Code (0)

등록된 구현이 없습니다.

Tasks

Deformable Object ManipulationObjectObject Reconstruction

Similar Papers 제목 키워드 기반

3DFS: Deformable Dense Depth Fusion and Segmentation for Object Reconstruction from a Handheld Camera

2016-06-15 · Tanmay Gupta, Daeyun Shin, Naren Sivagnanadasan, Derek Hoiem

We propose an approach for 3D reconstruction and segmentation of a single object placed on a flat surface from an input video. Our approach is to perform dense depth map estimation for multiple views using a proposed obj…

3D ReconstructionDepth EstimationObjectObject Reconstruction+2

Multi-modal deformable image registration using untrained neural networks

2024-11-04 · Quang Luong Nhat Nguyen, Ruiming Cao, Laura Waller

Image registration techniques usually assume that the images to be registered are of a certain type (e.g. single- vs. multi-modal, 2D vs. 3D, rigid vs. deformable) and there lacks a general method that can work for data …

Image Registration

HMDO: Markerless Multi-view Hand Manipulation Capture with Deformable Objects

2023-01-18 · Wei Xie, Zhipeng Yu, Zimeng Zhao, Binghui Zuo 외

We construct the first markerless deformable interaction dataset recording interactive motions of the hands and deformable objects, called HMDO (Hand Manipulation with Deformable Objects). With our built multi-view captu…

ObjectObject ReconstructionPose Estimation

DOFS: A Real-world 3D Deformable Object Dataset with Full Spatial Information for Dynamics Model Learning

2024-10-29 · Zhen Zhang, Xiangyu Chu, Yunxi Tang, K. W. Samuel Au

This work proposes DOFS, a pilot dataset of 3D deformable objects (DOs) (e.g., elasto-plastic objects) with full spatial information (i.e., top, side, and bottom information) using a novel and low-cost data collection pl…

Self-supervised Single-view 3D Reconstruction via Semantic Consistency

2020-03-13 · ECCV 2020 8 · Xueting Li, Sifei Liu, Kihwan Kim, Shalini De Mello 외

We learn a self-supervised, single-view 3D reconstruction model that predicts the 3D mesh shape, texture and camera pose of a target object with a collection of 2D images and silhouettes. The proposed method does not nec…

3D ReconstructionObjectSingle-View 3D Reconstruction