paper-with-me

Papers

Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion

2024-06-06 · Fangfu Liu, HanYang Wang, Shunyu Yao, Shengjun Zhang, Jie zhou, Yueqi Duan

In recent years, there has been rapid development in 3D generation models, opening up new possibilities for applications such as simulating the dynamic movements of 3D objects and customizing their behaviors. However, current 3D generative models tend to focus only on surface features such as color and shape, neglecting the inherent physical properties that govern the behavior of objects in the real world. To accurately simulate physics-aligned dynamics, it is essential to predict the physical properties of materials and incorporate them into the behavior prediction process. Nonetheless, predicting the diverse materials of real-world objects is still challenging due to the complex nature of their physical attributes. In this paper, we propose \textbf{Physics3D}, a novel method for learning various physical properties of 3D objects through a video diffusion model. Our approach involves designing a highly generalizable physical simulation system based on a viscoelastic material model, which enables us to simulate a wide range of materials with high-fidelity capabilities. Moreover, we distill the physical priors from a video diffusion model that contains more understanding of realistic object materials. Extensive experiments demonstrate the effectiveness of our method with both elastic and plastic materials. Physics3D shows great potential for bridging the gap between the physical world and virtual neural space, providing a better integration and application of realistic physical principles in virtual environments. Project page: https://liuff19.github.io/Physics3D.

📄 PDF Abstract BibTeX arXiv:2406.04338

Code (1)

liuff19/physics3d jax

Tasks

3D Generation

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

MAGIC: Motion-Aware Generative Inference via Confidence-Guided LLM

2025-05-22 · Siwei Meng, Yawei Luo, Ping Liu

Recent advances in static 3D generation have intensified the demand for physically consistent dynamic 3D content. However, existing video generation models, including diffusion-based methods, often prioritize visual real…

3D GenerationVideo Generation

GaussianProperty: Integrating Physical Properties to 3D Gaussians with LMMs

2024-12-15 · Xinli Xu, Wenhang Ge, Dicong Qiu, Zhifei Chen 외

Estimating physical properties for visual data is a crucial task in computer vision, graphics, and robotics, underpinning applications such as augmented reality, physical simulation, and robotic grasping. However, this a…

Material SegmentationRobotic Grasping

OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generation

2025-01-31 · YuChen Lin, Chenguo Lin, Jianjin Xu, Yadong Mu

Recently, significant advancements have been made in the reconstruction and generation of 3D assets, including static cases and those with physical interactions. To recover the physical properties of 3D assets, existing …

DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priors

2024-06-03 · Tianyu Huang, Haoze Zhang, Yihan Zeng, Zhilu Zhang 외

Dynamic 3D interaction has been attracting a lot of attention recently. However, creating such 4D content remains challenging. One solution is to animate 3D scenes with physics-based simulation, which requires manually a…

PhyCo: Learning Controllable Physical Priors for Generative Motion

2026-04-30 · Sriram Narayanan, Ziyu Jiang, Srinivasa Narasimhan, Manmohan Chandraker arxiv

Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic rebound, and material responses seldom match their underlying properties.…

Video Generation