paper-with-me

Papers

SceneX: Procedural Controllable Large-scale Scene Generation

2024-03-23 · Mengqi Zhou, Yuxi Wang, Jun Hou, Shougao Zhang, Yiwei Li, Chuanchen Luo, Junran Peng, Zhaoxiang Zhang

Developing comprehensive explicit world models is crucial for understanding and simulating real-world scenarios. Recently, Procedural Controllable Generation (PCG) has gained significant attention in large-scale scene generation by enabling the creation of scalable, high-quality assets. However, PCG faces challenges such as limited modular diversity, high expertise requirements, and challenges in managing the diverse elements and structures in complex scenes. In this paper, we introduce a large-scale scene generation framework, SceneX, which can automatically produce high-quality procedural models according to designers' textual descriptions. Specifically, the proposed method comprises two components, PCGHub and PCGPlanner. The former encompasses an extensive collection of accessible procedural assets and thousands of hand-craft API documents to perform as a standard protocol for PCG controller. The latter aims to generate executable actions for Blender to produce controllable and precise 3D assets guided by the user's instructions. Extensive experiments demonstrated the capability of our method in controllable large-scale scene generation, including nature scenes and unbounded cities, as well as scene editing such as asset placement and season translation.

📄 PDF Abstract BibTeX arXiv:2403.15698

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityLanguage ModellingLarge Language ModelScene Generation

Methods 이 논문이 사용한 방법론

RoIPool 설명 없음
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

4DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation

2026-08-27 · Zehao Qi, Haochen Luo, Jia-Wang Bian, Zeyu Ma 외 arxiv

Embodied agents need environments that are visually diverse, physically interactive, and changing over time. Procedural simulators can generate large interactive scene collections, and recent 4D generators produce compel…

Pro-DG: Procedural Diffusion Guidance for Architectural Facade Generation

2025-04-02 · Aleksander Plocharski, Jan Swidzinski, Przemyslaw Musialski

We present Pro-DG, a framework for procedurally controllable photo-realistic facade generation that combines a procedural shape grammar with diffusion-based image synthesis. Starting from a single input image, we reconst…

Image GenerationImage Manipulation

Sceniris: A Fast Procedural Scene Generation Framework

2025-12-18 · Jinghuan Shang, Harsh Patel, Ran Gong, Karl Schmeckpeper arxiv

Synthetic 3D scenes are essential for developing Physical AI and generative models. Existing procedural generation methods often have low output throughput, creating a significant bottleneck in scaling up dataset creatio…

Scene Generation

View-Dependent Octree-based Mesh Extraction in Unbounded Scenes for Procedural Synthetic Data

2023-12-13 · Zeyu Ma, Alexander Raistrick, Lahav Lipson, Jia Deng

Procedural synthetic data generation has received increasing attention in computer vision. Procedural signed distance functions (SDFs) are a powerful tool for modeling large-scale detailed scenes, but existing mesh extra…

Synthetic Data Generation

LychSim: A Controllable and Interactive Simulation Framework for Vision Research

2026-05-12 · Wufei Ma, Chloe Wang, Siyi Chen, Jiawei Peng 외 arxiv

While self-supervised pretraining has reduced vision systems' reliance on synthetic data, simulation remains an indispensable tool for closed-loop optimization and rigorous out-of-distribution (OOD) evaluation. However, …

Reinforcement Learning