paper-with-me

홈 › Papers

DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis

2023-03-24 · CVPR 2024 1 · Jiapeng Tang, Yinyu Nie, Lev Markhasin, Angela Dai, Justus Thies, Matthias Nießner

We present DiffuScene for indoor 3D scene synthesis based on a novel scene configuration denoising diffusion model. It generates 3D instance properties stored in an unordered object set and retrieves the most similar geometry for each object configuration, which is characterized as a concatenation of different attributes, including location, size, orientation, semantics, and geometry features. We introduce a diffusion network to synthesize a collection of 3D indoor objects by denoising a set of unordered object attributes. Unordered parametrization simplifies and eases the joint distribution approximation. The shape feature diffusion facilitates natural object placements, including symmetries. Our method enables many downstream applications, including scene completion, scene arrangement, and text-conditioned scene synthesis. Experiments on the 3D-FRONT dataset show that our method can synthesize more physically plausible and diverse indoor scenes than state-of-the-art methods. Extensive ablation studies verify the effectiveness of our design choice in scene diffusion models.

📄 PDF Abstract BibTeX arXiv:2303.14207

Code (1)

tangjiapeng/diffuscene pytorch

Tasks

DenoisingIndoor Scene SynthesisObject

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

External Knowledge Enhanced 3D Scene Generation from Sketch

2024-03-21 · Zijie Wu, Mingtao Feng, Yaonan Wang, He Xie 외

Generating realistic 3D scenes is challenging due to the complexity of room layouts and object geometries.We propose a sketch based knowledge enhanced diffusion architecture (SEK) for generating customized, diverse, and …

DenoisingObjectScene Generation

EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusion

2024-05-02 · Guangyao Zhai, Evin Pınar Örnek, Dave Zhenyu Chen, Ruotong Liao 외

We present EchoScene, an interactive and controllable generative model that generates 3D indoor scenes on scene graphs. EchoScene leverages a dual-branch diffusion model that dynamically adapts to scene graphs. Existing …

3D Object RetrievalDenoisingScene GenerationTexture Synthesis

Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model

2023-12-20 · Saurabh Saxena, Junhwa Hur, Charles Herrmann, Deqing Sun 외

While methods for monocular depth estimation have made significant strides on standard benchmarks, zero-shot metric depth estimation remains unsolved. Challenges include the joint modeling of indoor and outdoor scenes, w…

DenoisingDepth EstimationMonocular Depth Estimation

Mixed Diffusion for 3D Indoor Scene Synthesis

2024-05-31 · Siyi Hu, Diego Martin Arroyo, Stephanie Debats, Fabian Manhardt 외

Generating realistic 3D scenes is an area of growing interest in computer vision and robotics. However, creating high-quality, diverse synthetic 3D content often requires expert intervention, making it costly and complex…

DenoisingIndoor Scene Synthesis

DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generation

2023-06-01 · CVPR 2024 1 · Xiaoliang Ju, Zhaoyang Huang, Yijin Li, Guofeng Zhang 외

We present DiffInDScene, a novel framework for tackling the problem of high-quality 3D indoor scene generation, which is challenging due to the complexity and diversity of the indoor scene geometry. Although diffusion-ba…

3D Generation3D ReconstructionImage GenerationScene Generation