DOFS: A Real-world 3D Deformable Object Dataset with Full Spatial Information for Dynamics Model Learning
This work proposes DOFS, a pilot dataset of 3D deformable objects (DOs) (e.g., elasto-plastic objects) with full spatial information (i.e., top, side, and bottom information) using a novel and low-cost data collection platform with a transparent operating plane. The dataset consists of active manipulation action, multi-view RGB-D images, well-registered point clouds, 3D deformed mesh, and 3D occupancy with semantics, using a pinching strategy with a two-parallel-finger gripper. In addition, we trained a neural network with the down-sampled 3D occupancy and action as input to model the dynamics of an elasto-plastic object. Our dataset and all CADs of the data collection system will be released soon on our website.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
GenDOM: Generalizable One-shot Deformable Object Manipulation with Parameter-Aware Policy
Due to the inherent uncertainty in their deformability during motion, previous methods in deformable object manipulation, such as rope and cloth, often required hundreds of real-world demonstrations to train a manipulati…
Deformable Object ManipulationObjectBenchmarking the Sim-to-Real Gap in Cloth Manipulation
Realistic physics engines play a crucial role for learning to manipulate deformable objects such as garments in simulation. By doing so, researchers can circumvent challenges such as sensing the deformation of the object…
BenchmarkingMuJoCoObjectDeform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models
Predicting object dynamics (i.e., world modeling) is a fundamental challenge for robotic manipulation, and modeling deformable objects presents a particularly difficult case due to their high-dimensional state spaces and…
Registered and Segmented Deformable Object Reconstruction from a Single View Point Cloud
In deformable object manipulation, we often want to interact with specific segments of an object that are only defined in non-deformed models of the object. We thus require a system that can recognize and locate these se…
Deformable Object ManipulationObjectObject ReconstructionSim-to-Real Reinforcement Learning for Deformable Object Manipulation
We have seen much recent progress in rigid object manipulation, but interaction with deformable objects has notably lagged behind. Due to the large configuration space of deformable objects, solutions using traditional m…
Deep Reinforcement LearningDeformable Object ManipulationObjectreinforcement-learning+2