AI-supported Framework of Semi-Automatic Monoplotting for Monocular Oblique Visual Data Analysis
In the last decades, the development of smartphones, drones, aerial patrols, and digital cameras enabled high-quality photographs available to large populations and, thus, provides an opportunity to collect massive data of the nature and society with global coverage. However, the data collected with new photography tools is usually oblique - they are difficult to be georeferenced, and huge amounts of data is often obsolete. Georeferencing oblique imagery data may be solved by a technique called monoplotting, which only requires a single image and Digital Elevation Model (DEM). In traditional monoplotting, a human user has to manually choose a series of ground control point (GCP) pairs in the image and DEM and then determine the extrinsic and intrinsic parameters of the camera to establish a pixel-level correspondence between photos and the DEM to enable the mapping and georeferencing of objects in photos. This traditional method is difficult to scale due to several challenges including the labor-intensive inputs, the need of rich experience to identify well-defined GCPs, and limitations in camera pose estimation. Therefore, existing monoplotting methods are rarely used in analyzing large-scale databases or near-real-time warning systems. In this paper, we propose and demonstrate a novel semi-automatic monoplotting framework that provides pixel-level correspondence between photos and DEMs requiring minimal human interventions. A pipeline of analyses was developed including key point detection in images and DEM rasters, retrieving georeferenced 3D DEM GCPs, regularized gradient-based optimization, pose estimation, ray tracing, and the correspondence identification between image pixels and real world coordinates. Two numerical experiments show that the framework is superior in georeferencing visual data in 3-D coordinates, paving a way toward fully automatic monoplotting methodology.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
Semi-supervised Identification and Mapping of Surface Water Extent using Street-level Monitoring Videos
Urban flooding is becoming a common and devastating hazard to cause life loss and economic damage. Monitoring and understanding urban flooding in the local scale is a challenging task due to the complicated urban landsca…
SegmentationMonocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learning
We propose a novel semi-supervised active learning (SSAL) framework for monocular 3D object detection with LiDAR guidance (MonoLiG), which leverages all modalities of collected data during model development. We utilize L…
3D Object DetectionActive LearningMonocular 3D Object Detectionobject-detection+1Augment and Criticize: Exploring Informative Samples for Semi-Supervised Monocular 3D Object Detection
In this paper, we improve the challenging monocular 3D object detection problem with a general semi-supervised framework. Specifically, having observed that the bottleneck of this task lies in lacking reliable and inform…
3D Object DetectionMonocular 3D Object Detectionobject-detectionObject Detection+1Semi-Supervised Learning with Mutual Distillation for Monocular Depth Estimation
We propose a semi-supervised learning framework for monocular depth estimation. Compared to existing semi-supervised learning methods, which inherit limitations of both sparse supervised and unsupervised loss functions, …
Data AugmentationDepth EstimationMonocular Depth EstimationODM3D: Alleviating Foreground Sparsity for Semi-Supervised Monocular 3D Object Detection
Monocular 3D object detection (M3OD) is a significant yet inherently challenging task in autonomous driving due to absence of explicit depth cues in a single RGB image. In this paper, we strive to boost currently underpe…
3D Object DetectionAutonomous DrivingData AugmentationKnowledge Distillation+5