paper-with-me

홈 › Papers

3D detection of roof sections from a single satellite image and application to LOD2-building reconstruction

2023-07-11 · Johann Lussange, Mulin Yu, Yuliya Tarabalka, Florent Lafarge

Reconstructing urban areas in 3D out of satellite raster images has been a long-standing and challenging goal of both academical and industrial research. The rare methods today achieving this objective at a Level Of Details $2$ rely on procedural approaches based on geometry, and need stereo images and/or LIDAR data as input. We here propose a method for urban 3D reconstruction named KIBS(\textit{Keypoints Inference By Segmentation}), which comprises two novel features: i) a full deep learning approach for the 3D detection of the roof sections, and ii) only one single (non-orthogonal) satellite raster image as model input. This is achieved in two steps: i) by a Mask R-CNN model performing a 2D segmentation of the buildings' roof sections, and after blending these latter segmented pixels within the RGB satellite raster image, ii) by another identical Mask R-CNN model inferring the heights-to-ground of the roof sections' corners via panoptic segmentation, unto full 3D reconstruction of the buildings and city. We demonstrate the potential of the KIBS method by reconstructing different urban areas in a few minutes, with a Jaccard index for the 2D segmentation of individual roof sections of $88.55\%$ and $75.21\%$ on our two data sets resp., and a height's mean error of such correctly segmented pixels for the 3D reconstruction of $1.60$ m and $2.06$ m on our two data sets resp., hence within the LOD2 precision range.

📄 PDF Abstract BibTeX arXiv:2307.05409

Code (0)

등록된 구현이 없습니다.

Tasks

3D ReconstructionPanoptic SegmentationSegmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Satellite Sunroof: High-res Digital Surface Models and Roof Segmentation for Global Solar Mapping

2024-08-26 · Vishal Batchu, Alex Wilson, Betty Peng, Carl Elkin 외

The transition to renewable energy, particularly solar, is key to mitigating climate change. Google's Solar API aids this transition by estimating solar potential from aerial imagery, but its impact is constrained by geo…

3D Surface GenerationEarth ObservationInstance SegmentationSegmentation+2

Identifying safe intersection design through unsupervised feature extraction from satellite imagery

2020-10-29 · Jasper S. Wijnands, Haifeng Zhao, Kerry A. Nice, Jason Thompson 외

The World Health Organization has listed the design of safer intersections as a key intervention to reduce global road trauma. This article presents the first study to systematically analyze the design of all intersectio…

Enhanced Rooftop Solar Panel Detection by Efficiently Aggregating Local Features

2025-01-06 · Kuldeep Kurte, Kedar Kulkarni

In this paper, we present an enhanced Convolutional Neural Network (CNN)-based rooftop solar photovoltaic (PV) panel detection approach using satellite images. We propose to use pre-trained CNN-based model to extract the…

sat2pc: Estimating Point Cloud of Building Roofs from 2D Satellite Images

2022-05-25 · Yoones Rezaei, Stephen Lee

Three-dimensional (3D) urban models have gained interest because of their applications in many use-cases such as urban planning and virtual reality. However, generating these 3D representations requires LiDAR data, which…

Machine-learned 3D Building Vectorization from Satellite Imagery

2021-04-13 · Yi Wang, Stefano Zorzi, Ksenia Bittner

We propose a machine learning based approach for automatic 3D building reconstruction and vectorization. Taking a single-channel photogrammetric digital surface model (DSM) and panchromatic (PAN) image as input, we first…

Generative Adversarial NetworkSemantic Segmentation