paper-with-me

Papers

DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interaction

2025-03-07 · CVPR 2025 1 · Miaowei Wang, Yibo Zhang, Rui Ma, Weiwei Xu, Changqing Zou, Daniel Morris

We present DecoupledGaussian, a novel system that decouples static objects from their contacted surfaces captured in-the-wild videos, a key prerequisite for realistic Newtonian-based physical simulations. Unlike prior methods focused on synthetic data or elastic jittering along the contact surface, which prevent objects from fully detaching or moving independently, DecoupledGaussian allows for significant positional changes without being constrained by the initial contacted surface. Recognizing the limitations of current 2D inpainting tools for restoring 3D locations, our approach proposes joint Poisson fields to repair and expand the Gaussians of both objects and contacted scenes after separation. This is complemented by a multi-carve strategy to refine the object's geometry. Our system enables realistic simulations of decoupling motions, collisions, and fractures driven by user-specified impulses, supporting complex interactions within and across multiple scenes. We validate DecoupledGaussian through a comprehensive user study and quantitative benchmarks. This system enhances digital interaction with objects and scenes in real-world environments, benefiting industries such as VR, robotics, and autonomous driving. Our project page is at: https://wangmiaowei.github.io/DecoupledGaussian.github.io/.

📄 PDF Abstract BibTeX arXiv:2503.05484

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingObjectPhysical Simulations

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interaction

2026-05-19 · Xin Zhang, Yabo Chen, Yijie Fang, Wanying Qu 외 arxiv

Recent generative video models achieve impressive visual quality but remain constrained by limited physical consistency and controllability. Existing video generation methods provide minimal physical control, and single-…

3D ReconstructionScene GenerationVideo Generation3D Generation

3D-UIR: 3D Gaussian for Underwater 3D Scene Reconstruction via Physics Based Appearance-Medium Decoupling

2025-05-27 · Jieyu Yuan, YuJun Li, Yuanlin Zhang, Chunle Guo 외

Novel view synthesis for underwater scene reconstruction presents unique challenges due to complex light-media interactions. Optical scattering and absorption in water body bring inhomogeneous medium attenuation interfer…

3DGS3D Scene ReconstructionNovel View SynthesisUnderwater 3D Scene Reconstruction

Occlusion-Robust Multi-Object Decoupling for Physics-Based Robotic Interaction

2026-06-28 · Xin Dong, Lihan Zhang, Tianru Dai, Wenfeng Deng 외 arxiv

We propose a mask-free method for lossless multi-object 3D reconstruction from sparse and occluded real-world views, enabling physically plausible robotic interaction via Material Point Method (MPM) simulation. Our key i…

3D Reconstruction

Adding Intuitive Physics to Neural-Symbolic Capsules Using Interaction Networks

2019-05-23 · Michael Kissner, Helmut Mayer

Many current methods to learn intuitive physics are based on interaction networks and similar approaches. However, they rely on information that has proven difficult to estimate directly from image data in the past. We a…

A Compositional Object-Based Approach to Learning Physical Dynamics

2016-12-01 · Michael B. Chang, Tomer Ullman, Antonio Torralba, Joshua B. Tenenbaum

We present the Neural Physics Engine (NPE), a framework for learning simulators of intuitive physics that naturally generalize across variable object count and different scene configurations. We propose a factorization o…

Object