Learning to Generate 3D Representations of Building Roofs Using Single-View Aerial Imagery
We present a novel pipeline for learning the conditional distribution of a building roof mesh given pixels from an aerial image, under the assumption that roof geometry follows a set of regular patterns. Unlike alternative methods that require multiple images of the same object, our approach enables estimating 3D roof meshes using only a single image for predictions. The approach employs the PolyGen, a deep generative transformer architecture for 3D meshes. We apply this model in a new domain and investigate the sensitivity of the image resolution. We propose a novel metric to evaluate the performance of the inferred meshes, and our results show that the model is robust even at lower resolutions, while qualitatively producing realistic representations for out-of-distribution samples.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
BuilDiff: 3D Building Shape Generation using Single-Image Conditional Point Cloud Diffusion Models
3D building generation with low data acquisition costs, such as single image-to-3D, becomes increasingly important. However, most of the existing single image-to-3D building creation works are restricted to those images …
DenoisingImage to 3D3D Instance Segmentation of MVS Buildings
We present a novel 3D instance segmentation framework for Multi-View Stereo (MVS) buildings in urban scenes. Unlike existing works focusing on semantic segmentation of urban scenes, the emphasis of this work lies in dete…
3D Instance SegmentationInstance SegmentationSegmentationSemantic Segmentationsat2pc: Estimating Point Cloud of Building Roofs from 2D Satellite Images
Three-dimensional (3D) urban models have gained interest because of their applications in many use-cases such as urban planning and virtual reality. However, generating these 3D representations requires LiDAR data, which…
Interpreting Robustness Proofs of Deep Neural Networks
In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs beha…
Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds
3D urban reconstruction of buildings from remotely sensed imagery has drawn significant attention during the past two decades. While aerial imagery and LiDAR provide higher resolution, satellite imagery is cheaper and mo…
3D Reconstruction