paper-with-me

홈 › Papers

Deep cross-domain building extraction for selective depth estimation from oblique aerial imagery

2018-04-23 · Boitumelo Ruf, Laurenz Thiel, Martin Weinmann

With the technological advancements of aerial imagery and accurate 3d reconstruction of urban environments, more and more attention has been paid to the automated analyses of urban areas. In our work, we examine two important aspects that allow live analysis of building structures in city models given oblique aerial imagery, namely automatic building extraction with convolutional neural networks (CNNs) and selective real-time depth estimation from aerial imagery. We use transfer learning to train the Faster R-CNN method for real-time deep object detection, by combining a large ground-based dataset for urban scene understanding with a smaller number of images from an aerial dataset. We achieve an average precision (AP) of about 80% for the task of building extraction on a selected evaluation dataset. Our evaluation focuses on both dataset-specific learning and transfer learning. Furthermore, we present an algorithm that allows for multi-view depth estimation from aerial imagery in real-time. We adopt the semi-global matching (SGM) optimization strategy to preserve sharp edges at object boundaries. In combination with the Faster R-CNN, it allows a selective reconstruction of buildings, identified with regions of interest (RoIs), from oblique aerial imagery.

📄 PDF Abstract BibTeX arXiv:1804.08302

Code (0)

등록된 구현이 없습니다.

Tasks

3D ReconstructionDepth Estimationobject-detectionObject DetectionScene UnderstandingTransfer Learning

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIPool 설명 없음
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Similar Papers 제목 키워드 기반

Radically Lower Data-Labeling Costs for Visually Rich Document Extraction Models

2022-10-28 · Yichao Zhou, James B. Wendt, Navneet Potti, Jing Xie 외

A key bottleneck in building automatic extraction models for visually rich documents like invoices is the cost of acquiring the several thousand high-quality labeled documents that are needed to train a model with accept…

Active Learning

M3D: Dual-Stream Selective State Spaces and Depth-Driven Framework for High-Fidelity Single-View 3D Reconstruction

2024-11-19 · Luoxi Zhang, Pragyan Shrestha, Yu Zhou, Chun Xie 외

The precise reconstruction of 3D objects from a single RGB image in complex scenes presents a critical challenge in virtual reality, autonomous driving, and robotics. Existing neural implicit 3D representation methods fa…

3D ReconstructionAutonomous DrivingSingle-View 3D Reconstruction

ROIFormer: Semantic-Aware Region of Interest Transformer for Efficient Self-Supervised Monocular Depth Estimation

2022-12-12 · Daitao Xing, Jinglin Shen, Chiuman Ho, Anthony Tzes

The exploration of mutual-benefit cross-domains has shown great potential toward accurate self-supervised depth estimation. In this work, we revisit feature fusion between depth and semantic information and propose an ef…

Depth EstimationMonocular Depth Estimation

Uncertainty-Guided Selective Adaptation Enables Cross-Platform Predictive Fluorescence Microscopy

2025-11-15 · Kai-Wen K. Yang, Andrew Bai, Alexandra Bermudez, Yunqi Hong 외 arxiv

Deep learning is transforming microscopy, yet models often fail when applied to images from new instruments or acquisition settings. Conventional adversarial domain adaptation (ADDA) retrains entire networks, often disru…

Domain Adaptation

Quality-aware Selective Fusion Network for V-D-T Salient Object Detection

2024-05-13 · Liuxin Bao, Xiaofei Zhou, Xiankai Lu, Yaoqi Sun 외

Depth images and thermal images contain the spatial geometry information and surface temperature information, which can act as complementary information for the RGB modality. However, the quality of the depth and thermal…

object-detectionObject DetectionPseudo LabelSalient Object Detection