DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interaction
We present DecoupledGaussian, a novel system that decouples static objects from their contacted surfaces captured in-the-wild videos, a key prerequisite for realistic Newtonian-based physical simulations. Unlike prior methods focused on synthetic data or elastic jittering along the contact surface, which prevent objects from fully detaching or moving independently, DecoupledGaussian allows for significant positional changes without being constrained by the initial contacted surface. Recognizing the limitations of current 2D inpainting tools for restoring 3D locations, our approach proposes joint Poisson fields to repair and expand the Gaussians of both objects and contacted scenes after separation. This is complemented by a multi-carve strategy to refine the object's geometry. Our system enables realistic simulations of decoupling motions, collisions, and fractures driven by user-specified impulses, supporting complex interactions within and across multiple scenes. We validate DecoupledGaussian through a comprehensive user study and quantitative benchmarks. This system enhances digital interaction with objects and scenes in real-world environments, benefiting industries such as VR, robotics, and autonomous driving. Our project page is at: https://wangmiaowei.github.io/DecoupledGaussian.github.io/.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingObjectPhysical SimulationsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interaction
Recent generative video models achieve impressive visual quality but remain constrained by limited physical consistency and controllability. Existing video generation methods provide minimal physical control, and single-…
3D ReconstructionScene GenerationVideo Generation3D Generation3D-UIR: 3D Gaussian for Underwater 3D Scene Reconstruction via Physics Based Appearance-Medium Decoupling
Novel view synthesis for underwater scene reconstruction presents unique challenges due to complex light-media interactions. Optical scattering and absorption in water body bring inhomogeneous medium attenuation interfer…
3DGS3D Scene ReconstructionNovel View SynthesisUnderwater 3D Scene ReconstructionOcclusion-Robust Multi-Object Decoupling for Physics-Based Robotic Interaction
We propose a mask-free method for lossless multi-object 3D reconstruction from sparse and occluded real-world views, enabling physically plausible robotic interaction via Material Point Method (MPM) simulation. Our key i…
3D ReconstructionAdding Intuitive Physics to Neural-Symbolic Capsules Using Interaction Networks
Many current methods to learn intuitive physics are based on interaction networks and similar approaches. However, they rely on information that has proven difficult to estimate directly from image data in the past. We a…
A Compositional Object-Based Approach to Learning Physical Dynamics
We present the Neural Physics Engine (NPE), a framework for learning simulators of intuitive physics that naturally generalize across variable object count and different scene configurations. We propose a factorization o…
Object