paper-with-me

홈 › Papers

NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenes

2025-03-20 · Han-Hung Lee, Qinghong Han, Angel X. Chang

In this paper, we explore the task of generating expansive outdoor scenes, ranging from castles to high-rises. Unlike indoor scene generation, which has been a primary focus of prior work, outdoor scene generation presents unique challenges, including wide variations in scene heights and the need for a method capable of rapidly producing large landscapes. To address this, we propose an efficient approach that encodes scene chunks as uniform vector sets, offering better compression and performance than the spatially structured latents used in prior methods. Furthermore, we train an explicit outpainting model for unbounded generation, which improves coherence compared to prior resampling-based inpainting schemes while also speeding up generation by eliminating extra diffusion steps. To facilitate this task, we curate NuiScene43, a small but high-quality set of scenes, preprocessed for joint training. Notably, when trained on scenes of varying styles, our model can blend different environments, such as rural houses and city skyscrapers, within the same scene, highlighting the potential of our curation process to leverage heterogeneous scenes for joint training.

📄 PDF Abstract BibTeX arXiv:2503.16375

Code (1)

3dlg-hcvc/NuiScene 공식 구현 pytorch

Tasks

Scene Generation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.
Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

SAMPLING: Scene-adaptive Hierarchical Multiplane Images Representation for Novel View Synthesis from a Single Image

2023-09-12 · ICCV 2023 1 · Xiaoyu Zhou, Zhiwei Lin, Xiaojun Shan, Yongtao Wang 외

Recent novel view synthesis methods obtain promising results for relatively small scenes, e.g., indoor environments and scenes with a few objects, but tend to fail for unbounded outdoor scenes with a single image as inpu…

Novel View Synthesis

WorldFlow3D: Flowing Through 3D Distributions for Unbounded World Generation

2026-03-31 · Amogh Joshi, Julian Ost, Felix Heide arxiv

Unbounded 3D world generation is emerging as a foundational task for scene modeling in computer vision, graphics, and robotics. In this work, we present WorldFlow3D, a novel method capable of generating unbounded 3D worl…

Scene Generation3D Generation

NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes

2023-08-24 · ICCV 2023 1 · Muhammad Zubair Irshad, Sergey Zakharov, Katherine Liu, Vitor Guizilini 외

Recent implicit neural representations have shown great results for novel view synthesis. However, existing methods require expensive per-scene optimization from many views hence limiting their application to real-world …

Generalizable Novel View SynthesisNovel View Synthesis

SceneFrom3D: Geometry-Conditioned Outdoor 3D Scene Generation via View Scheduling with Object-Level Control

2026-07-05 · Geonung Kim, Jeongeun Park, Nuri Ryu, Di Liu 외 hf

Geometry-conditioned 3D scene generation enables the creation of 3D environments from user-provided geometry, offering direct control over scene structure and object layout. To generate such 3D scenes, current methods co…

Scene Generation

MM-Gaussian: 3D Gaussian-based Multi-modal Fusion for Localization and Reconstruction in Unbounded Scenes

2024-04-05 · Chenyang Wu, Yifan Duan, Xinran Zhang, Yu Sheng 외

Localization and mapping are critical tasks for various applications such as autonomous vehicles and robotics. The challenges posed by outdoor environments present particular complexities due to their unbounded character…

Autonomous Vehicles