Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians
Reconstructing and simulating elastic objects from visual observations is crucial for applications in computer vision and robotics. Existing methods, such as 3D Gaussians, model 3D appearance and geometry, but lack the ability to estimate physical properties for objects and simulate them. The core challenge lies in integrating an expressive yet efficient physical dynamics model. We propose Spring-Gaus, a 3D physical object representation for reconstructing and simulating elastic objects from videos of the object from multiple viewpoints. In particular, we develop and integrate a 3D Spring-Mass model into 3D Gaussian kernels, enabling the reconstruction of the visual appearance, shape, and physical dynamics of the object. Our approach enables future prediction and simulation under various initial states and environmental properties. We evaluate Spring-Gaus on both synthetic and real-world datasets, demonstrating accurate reconstruction and simulation of elastic objects. Project page: https://zlicheng.com/spring_gaus/.
Code (0)
등록된 구현이 없습니다.
Tasks
Future predictionObjectSimilar Papers 제목 키워드 기반
NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videos
In this paper, we aim to create physical digital twins of deformable objects under interaction. Existing methods focus more on the physical learning of current state modeling, but generalize worse to future prediction. T…
BendTwin: Robust Dense-to-Sparse Physical Reconstruction with Bending-Aware Differentiable Spring-Mass Models
Reconstructing objects with mechanical properties from video observations enables physically consistent dynamic prediction, benefiting robotics planning and interaction. Existing spring--mass based physical driven recons…
PhySPRING: Structure-Preserving Reduction of Physics-Informed Twins via GNN
Physics-based digital twins aim to predict the dynamics of real-world objects under interaction, enabling real-to-sim-to-real applications in robotics. Current approaches reconstruct such twins as explicit physical model…
PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos
Creating a physical digital twin of a real-world object has immense potential in robotics, content creation, and XR. In this paper, we present PhysTwin, a novel framework that uses sparse videos of dynamic objects under …
4D reconstructionDeformable Object ManipulationFuture predictionMotion Planning+1Cooperative Aerial Transportation of Nonuniform Load through Quadrotors by Elastic and Flexible Cables
In this paper, first the full dynamics of aerial transportation of a rigid body with arbitrary number of quadrotors is derived. Then a control strategy is proposed to convey the nonuniform rigid body appropriately to the…