paper-with-me

Papers

PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image

2025-11-17 · Ziang Cao, Fangzhou Hong, Zhaoxi Chen, Liang Pan, Ziwei Liu arxiv

3D modeling is shifting from static visual representations toward physical, articulated assets that can be directly used in simulation and interaction. However, most existing 3D generation methods overlook key physical and articulation properties, thereby limiting their utility in embodied AI. To bridge this gap, we introduce PhysX-Anything, the first simulation-ready physical 3D generative framework that, given a single in-the-wild image, produces high-quality sim-ready 3D assets with explicit geometry, articulation, and physical attributes. Specifically, we propose the first VLM-based physical 3D generative model, along with a new 3D representation that efficiently tokenizes geometry. It reduces the number of tokens by 193x, enabling explicit geometry learning within standard VLM token budgets without introducing any special tokens during fine-tuning and significantly improving generative quality. In addition, to overcome the limited diversity of existing physical 3D datasets, we construct a new dataset, PhysX-Mobility, which expands the object categories in prior physical 3D datasets by over 2x and includes more than 2K common real-world objects with rich physical annotations. Extensive experiments on PhysX-Mobility and in-the-wild images demonstrate that PhysX-Anything delivers strong generative performance and robust generalization. Furthermore, simulation-based experiments in a MuJoCo-style environment validate that our sim-ready assets can be directly used for contact-rich robotic policy learning. We believe PhysX-Anything can substantially empower a broad range of downstream applications, especially in embodied AI and physics-based simulation.

📄 PDF Abstract BibTeX arXiv:2511.13648

Code (0)

등록된 구현이 없습니다.

Tasks

3D Generation

Similar Papers 제목 키워드 기반

PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects

2026-05-20 · Ziang Cao, Yinghao Liu, Haitian Li, Runmao Yao 외 arxiv

Simulation-ready physical 3D assets have emerged as a promising direction owing to their broad applicability in downstream tasks. However, most existing 3D generation methods either neglect physical properties or are lim…

Scene Generation3D Generation

PhysX: Physical-Grounded 3D Asset Generation

2025-07-16 · Ziang Cao, Zhaoxi Chen, Linag Pan, Ziwei Liu

3D modeling is moving from virtual to physical. Existing 3D generation primarily emphasizes geometries and textures while neglecting physical-grounded modeling. Consequently, despite the rapid development of 3D generativ…

3D GenerationImage to 3D

AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation

2026-06-16 · Haoran Lu, Mutian Shen, Shuyang Yu, Yu Xiao 외 arxiv

Simulation enables scalable robot data collection, but raw 3D assets provide only geometry, lacking the semantic, interactive, and physical knowledge needed to specify where and how robots should act. In this work, we pr…

Affordance DetectionRobot Manipulation

URDF-Anything+: End-to-End Generation for Simulation-Ready Articulated Assets

2026-03-14 · Zhuangzhe Wu, Yue Xin, Chengkai Hou, Minghao Chen 외 arxiv

Articulated objects are fundamental for robotics, simulation of physics, and interactive virtual environments. However, recovering them from visual observations is inherently challenging, as images provide only partial a…

SceneFactory: GPU-Accelerated Multi-Agent Driving Simulation with Physics-Based Vehicle Dynamics

2026-05-08 · Yicheng Zhu, Yang Chen, Tao Li, Zilin Bian arxiv

Autonomous-driving simulators typically trade physical fidelity for scalable parallelism. Physics-based platforms such as CARLA and MetaDrive provide articulated vehicle dynamics and contact, but their non-vectorized int…