paper-with-me

홈 › Papers

3D Scene Generation: A Survey

2025-05-08 · Beichen Wen, Haozhe Xie, Zhaoxi Chen, Fangzhou Hong, Ziwei Liu

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on procedural rules offered scalability but limited diversity. Recent advances in deep generative models (e.g., GANs, diffusion models) and 3D representations (e.g., NeRF, 3D Gaussians) have enabled the learning of real-world scene distributions, improving fidelity, diversity, and view consistency. Recent advances like diffusion models bridge 3D scene synthesis and photorealism by reframing generation as image or video synthesis problems. This survey provides a systematic overview of state-of-the-art approaches, organizing them into four paradigms: procedural generation, neural 3D-based generation, image-based generation, and video-based generation. We analyze their technical foundations, trade-offs, and representative results, and review commonly used datasets, evaluation protocols, and downstream applications. We conclude by discussing key challenges in generation capacity, 3D representation, data and annotations, and evaluation, and outline promising directions including higher fidelity, physics-aware and interactive generation, and unified perception-generation models. This review organizes recent advances in 3D scene generation and highlights promising directions at the intersection of generative AI, 3D vision, and embodied intelligence. To track ongoing developments, we maintain an up-to-date project page: https://github.com/hzxie/Awesome-3D-Scene-Generation.

📄 PDF Abstract BibTeX arXiv:2505.05474

Code (1)

hzxie/awesome-3d-scene-generation 공식 구현

Tasks

Autonomous DrivingDiversityNeRFScene GenerationSurvey

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospects

2025-05-28 · IEEE Access 2025 5 · Awal Ahmed Fime, Saifuddin Mahmud, Arpita Das, Md. Sunzidul Islam 외

Automatic scene generation is an essential area of research with applications in robotics, recreation, visual representation, training and simulation, education, and more. This survey provides a comprehensive review of t…

3D GenerationImage to 3DScene GenerationSurvey+1

Scene Graph Generation: A Comprehensive Survey

2022-01-03 · Guangming Zhu, Liang Zhang, Youliang Jiang, Yixuan Dang 외

Deep learning techniques have led to remarkable breakthroughs in the field of generic object detection and have spawned a lot of scene-understanding tasks in recent years. Scene graph has been the focus of research becau…

Graph Generationobject-detectionObject DetectionRelationship Detection+4

Recent Advance in 3D Object and Scene Generation: A Survey

2025-04-16 · Xiang Tang, Ruotong Li, Xiaopeng Fan

In recent years, the demand for 3D content has grown exponentially with intelligent upgrading of interactive media, extended reality (XR), and Metaverse industries. In order to overcome the limitation of traditional manu…

3D GenerationObjectScene GenerationSurvey

A Comprehensive Survey on Synthetic Infrared Image synthesis

2024-08-13 · Avinash Upadhyay, Manoj Sharma, Prerana Mukherjee, Amit Singhal 외

Synthetic infrared (IR) scene and target generation is an important computer vision problem as it allows the generation of realistic IR images and targets for training and testing of various applications, such as remote …

Image GenerationSurvey

Neural Radiance Fields for the Real World: A Survey

2025-01-22 · Wenhui Xiao, Remi Chierchia, Rodrigo Santa Cruz, Xuesong Li 외

Neural Radiance Fields (NeRFs) have remodeled 3D scene representation since release. NeRFs can effectively reconstruct complex 3D scenes from 2D images, advancing different fields and applications such as scene understan…

Scene UnderstandingSurvey