Pano Popups: Indoor 3D Reconstruction with a Plane-Aware Network
In this work we present a method to train a plane-aware convolutional neural network for dense depth and surface normal estimation as well as plane boundaries from a single indoor $360^\circ$ image. Using our proposed loss function, our network outperforms existing methods for single-view, indoor, omnidirectional depth estimation and provides an initial benchmark for surface normal prediction from $360^\circ$ images. Our improvements are due to the use of a novel plane-aware loss that leverages principal curvature as an indicator of planar boundaries. We also show that including geodesic coordinate maps as network priors provides a significant boost in surface normal prediction accuracy. Finally, we demonstrate how we can combine our network's outputs to generate high quality 3D "pop-up" models of indoor scenes.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionDepth EstimationSurface Normal EstimationSimilar Papers 제목 키워드 기반
Indoor Panorama Planar 3D Reconstruction via Divide and Conquer
Indoor panorama typically consists of human-made structures parallel or perpendicular to gravity. We leverage this phenomenon to approximate the scene in a 360-degree image with (H)orizontal-planes and (V)ertical-planes.…
3D ReconstructionInstance SegmentationSemantic SegmentationTranslationLayout-guided Indoor Panorama Inpainting with Plane-aware Normalization
We present an end-to-end deep learning framework for indoor panoramic image inpainting. Although previous inpainting methods have shown impressive performance on natural perspective images, most fail to handle panoramic …
Image InpaintingPanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splatting
We present PanoPlane, an approach for high-fidelity sparse-view indoor novel view synthesis that reconstructs closed room geometry via panoramic scene completion. Unlike perspective-based methods that generate training v…
Novel View SynthesisOmniIndoor3D: Comprehensive Indoor 3D Reconstruction
We propose a novel framework for comprehensive indoor 3D reconstruction using Gaussian representations, called OmniIndoor3D. This framework enables accurate appearance, geometry, and panoptic reconstruction of diverse in…
3DGS3D ReconstructionScene UnderstandingLocal-to-Global Panorama Inpainting for Locale-Aware Indoor Lighting Prediction
Predicting panoramic indoor lighting from a single perspective image is a fundamental but highly ill-posed problem in computer vision and graphics. To achieve locale-aware and robust prediction, this problem can be decom…
HDR Reconstruction