DLO-Splatting: Tracking Deformable Linear Objects Using 3D Gaussian Splatting
This work presents DLO-Splatting, an algorithm for estimating the 3D shape of Deformable Linear Objects (DLOs) from multi-view RGB images and gripper state information through prediction-update filtering. The DLO-Splatting algorithm uses a position-based dynamics model with shape smoothness and rigidity dampening corrections to predict the object shape. Optimization with a 3D Gaussian Splatting-based rendering loss iteratively renders and refines the prediction to align it with the visual observations in the update step. Initial experiments demonstrate promising results in a knot tying scenario, which is challenging for existing vision-only methods.
Code (0)
등록된 구현이 없습니다.
Tasks
PositionPredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DeformGS: Scene Flow in Highly Deformable Scenes for Deformable Object Manipulation
Teaching robots to fold, drape, or reposition deformable objects such as cloth will unlock a variety of automation applications. While remarkable progress has been made for rigid object manipulation, manipulating deforma…
Deformable Object ManipulationImitation LearningNovel View SynthesisPose EstimationMotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splatting
Dynamic scene reconstruction is a long-term challenge in the field of 3D vision. Recently, the emergence of 3D Gaussian Splatting has provided new insights into this problem. Although subsequent efforts rapidly extend st…
3D ReconstructionDynamic ReconstructionMotion EstimationNovel View Synthesis+1Efficient Gaussian Splatting for Monocular Dynamic Scene Rendering via Sparse Time-Variant Attribute Modeling
Rendering dynamic scenes from monocular videos is a crucial yet challenging task. The recent deformable Gaussian Splatting has emerged as a robust solution to represent real-world dynamic scenes. However, it often leads …
AttributeObject and Contact Point Tracking in Demonstrations Using 3D Gaussian Splatting
This paper introduces a method to enhance Interactive Imitation Learning (IIL) by extracting touch interaction points and tracking object movement from video demonstrations. The approach extends current IIL systems by pr…
Imitation LearningPoint TrackingUPETrack: Unidirectional Position Estimation for Tracking Occluded Deformable Linear Objects
Real-time state tracking of Deformable Linear Objects (DLOs) is critical for enabling robotic manipulation of DLOs in industrial assembly, medical procedures, and daily-life applications. However, the high-dimensional co…
Computational Efficiency