paper-with-me

Papers

DepthGAN: GAN-based Depth Generation of Indoor Scenes from Semantic Layouts

2022-03-22 · Yidi Li, Yiqun Wang, Zhengda Lu, Jun Xiao

Limited by the computational efficiency and accuracy, generating complex 3D scenes remains a challenging problem for existing generation networks. In this work, we propose DepthGAN, a novel method of generating depth maps with only semantic layouts as input. First, we introduce a well-designed cascade of transformer blocks as our generator to capture the structural correlations in depth maps, which makes a balance between global feature aggregation and local attention. Meanwhile, we propose a cross-attention fusion module to guide edge preservation efficiently in depth generation, which exploits additional appearance supervision information. Finally, we conduct extensive experiments on the perspective views of the Structured3d panorama dataset and demonstrate that our DepthGAN achieves superior performance both on quantitative results and visual effects in the depth generation task.Furthermore, 3D indoor scenes can be reconstructed by our generated depth maps with reasonable structure and spatial coherency.

📄 PDF Abstract BibTeX arXiv:2203.11453

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Indoor Scene Generation from a Collection of Semantic-Segmented Depth Images

2021-08-20 · ICCV 2021 10 · Ming-Jia Yang, Yu-Xiao Guo, Bin Zhou, Xin Tong

We present a method for creating 3D indoor scenes with a generative model learned from a collection of semantic-segmented depth images captured from different unknown scenes. Given a room with a specified size, our metho…

Generative Adversarial NetworkScene Generation

SceneCraft: Layout-Guided 3D Scene Generation

2024-10-11 · Xiuyu Yang, Yunze Man, Jun-Kun Chen, Yu-Xiong Wang

The creation of complex 3D scenes tailored to user specifications has been a tedious and challenging task with traditional 3D modeling tools. Although some pioneering methods have achieved automatic text-to-3D generation…

3D GenerationImage GenerationNeRFScene Generation+1

3D-Aware Indoor Scene Synthesis with Depth Priors

2022-02-17 · Zifan Shi, Yujun Shen, Jiapeng Zhu, Dit-yan Yeung 외

Despite the recent advancement of Generative Adversarial Networks (GANs) in learning 3D-aware image synthesis from 2D data, existing methods fail to model indoor scenes due to the large diversity of room layouts and the …

3D-Aware Image Synthesis3D geometryDiversityImage Generation+1

ScaleDepth: Decomposing Metric Depth Estimation into Scale Prediction and Relative Depth Estimation

2024-07-11 · Ruijie Zhu, Chuxin Wang, Ziyang Song, Li Liu 외

Estimating depth from a single image is a challenging visual task. Compared to relative depth estimation, metric depth estimation attracts more attention due to its practical physical significance and critical applicatio…

Depth EstimationMonocular Depth Estimation

Learning to Reconstruct and Understand Indoor Scenes from Sparse Views

2019-06-19 · Jingyu Yang, Ji Xu, Kun Li, Yu-Kun Lai 외

This paper proposes a new method for simultaneous 3D reconstruction and semantic segmentation of indoor scenes. Unlike existing methods that require recording a video using a color camera and/or a depth camera, our metho…

3D ReconstructionDepth EstimationSegmentationSemantic Segmentation