paper-with-me

홈 › Papers

Comp4D: LLM-Guided Compositional 4D Scene Generation

2024-03-25 · Dejia Xu, Hanwen Liang, Neel P. Bhatt, Hezhen Hu, Hanxue Liang, Konstantinos N. Plataniotis, Zhangyang Wang

Recent advancements in diffusion models for 2D and 3D content creation have sparked a surge of interest in generating 4D content. However, the scarcity of 3D scene datasets constrains current methodologies to primarily object-centric generation. To overcome this limitation, we present Comp4D, a novel framework for Compositional 4D Generation. Unlike conventional methods that generate a singular 4D representation of the entire scene, Comp4D innovatively constructs each 4D object within the scene separately. Utilizing Large Language Models (LLMs), the framework begins by decomposing an input text prompt into distinct entities and maps out their trajectories. It then constructs the compositional 4D scene by accurately positioning these objects along their designated paths. To refine the scene, our method employs a compositional score distillation technique guided by the pre-defined trajectories, utilizing pre-trained diffusion models across text-to-image, text-to-video, and text-to-3D domains. Extensive experiments demonstrate our outstanding 4D content creation capability compared to prior arts, showcasing superior visual quality, motion fidelity, and enhanced object interactions.

📄 PDF Abstract BibTeX arXiv:2403.16993

Code (0)

등록된 구현이 없습니다.

Tasks

ObjectScene GenerationText to 3D

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

LAYOUTDREAMER: Physics-guided Layout for Text-to-3D Compositional Scene Generation

2025-02-04 · Yang Zhou, Zongjin He, Qixuan Li, Chao Wang

Recently, the field of text-guided 3D scene generation has garnered significant attention. High-quality generation that aligns with physical realism and high controllability is crucial for practical 3D scene applications…

3DGSScene GenerationText to 3D

GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting

2024-02-11 · Xiaoyu Zhou, Xingjian Ran, Yajiao Xiong, Jinlin He 외

We present GALA3D, generative 3D GAussians with LAyout-guided control, for effective compositional text-to-3D generation. We first utilize large language models (LLMs) to generate the initial layout and introduce a layou…

3D GenerationScene GenerationText to 3D

MALeR: Improving Compositional Fidelity in Layout-Guided Generation

2025-11-08 · Shivank Saxena, Dhruv Srivastava, Makarand Tapaswi arxiv

Recent advances in text-to-image models have enabled a new era of creative and controllable image generation. However, generating compositional scenes with multiple subjects and attributes remains a significant challenge…

Image Generation

PhiP-G: Physics-Guided Text-to-3D Compositional Scene Generation

2025-02-02 · Qixuan Li, Chao Wang, Zongjin He, Yan Peng

Text-to-3D asset generation has achieved significant optimization under the supervision of 2D diffusion priors. However, when dealing with compositional scenes, existing methods encounter several challenges: 1). failure …

Scene GenerationText to 3D

LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning

2025-09-24 · Zezhong Fan, Xiaohan Li, Luyi Ma, Kai Zhao 외 arxiv

Designing realistic multi-object scenes requires not only generating images, but also planning spatial layouts that respect semantic relations and physical plausibility. On one hand, while recent advances in diffusion mo…

Spatial ReasoningImage Generation