Single View Geocentric Pose in the Wild
Current methods for Earth observation tasks such as semantic mapping, map alignment, and change detection rely on near-nadir images; however, often the first available images in response to dynamic world events such as natural disasters are oblique. These tasks are much more difficult for oblique images due to observed object parallax. There has been recent success in learning to regress geocentric pose, defined as height above ground and orientation with respect to gravity, by training with airborne lidar registered to satellite images. We present a model for this novel task that exploits affine invariance properties to outperform state of the art performance by a wide margin. We also address practical issues required to deploy this method in the wild for real-world applications. Our data and code are publicly available.
Code (1)
Tasks
Change DetectionEarth ObservationSimilar Papers 제목 키워드 기반
Learning Geocentric Object Pose in Oblique Monocular Images
An object's geocentric pose, defined as the height above ground and orientation with respect to gravity, is a powerful representation of real-world structure for object detection, segmentation, and localization tasks usi…
Earth ObservationObjectobject-detectionObject Detection+2Learning Rich Features from RGB-D Images for Object Detection and Segmentation
In this paper we study the problem of object detection for RGB-D images using semantically rich image and depth features. We propose a new geocentric embedding for depth images that encodes height above ground and angle …
Instance SegmentationObjectobject-detectionObject Detection+3A Deep Learning Ensemble Framework for Off-Nadir Geocentric Pose Prediction
Computational methods to accelerate natural disaster response include change detection, map alignment, and vision-aided navigation. Current software functions optimally only on near-nadir images, though off-nadir images …
Change DetectionDisaster ResponseFeature EngineeringPose PredictionLearning Single-Image Depth from Videos using Quality Assessment Networks
Depth estimation from a single image in the wild remains a challenging problem. One main obstacle is the lack of high-quality training data for images in the wild. In this paper we propose a method to automatically gener…
Depth EstimationCalibAnyView: Beyond Single-View Camera Calibration in the Wild
Camera calibration is a fundamental prerequisite for reliable geometric perception, yet classical approaches rely on controlled acquisition setups that are impractical for in-the-wild imagery. Recent learning-based metho…
3D Reconstruction