3D Reconstruction from public webcams
We investigate the possibility of 3D scene reconstruction from two or more overlapping webcam streams. A large, and growing, number of webcams observe places of interest and are publicly accessible. The question naturally arises: can we make use of this free data source for 3D computer vision? It turns out that the task to reconstruct scene structure from webcam streams is very different from standard structure-from-motion (SfM), and conventional SfM pipelines fail. In the webcam setting there are very few views of the same scene, in most cases only the minimum of two. These viewpoints often have large baselines and/or scale differences, their overlap is rather limited, and besides unknown internal and external calibration also their temporal synchronisation is unknown. On the other hand, they record rather large fields of view continuously over long time spans, so that they regularly observe dynamic objects moving through the scene. We show how to leverage recent advances in several areas of computer vision to adapt SfM reconstruction to this particular scenario and reconstruct the unknown camera poses, the 3D scene structure, and the 3D trajectories of dynamic objects.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Reconstruction3D Scene ReconstructionSimilar Papers 제목 키워드 기반
Real-time Halfway Domain Reconstruction of Motion and Geometry
We present a novel approach for real-time joint reconstruction of 3D scene motion and geometry from binocular stereo videos. Our approach is based on a novel variational halfway-domain scene flow formulation, which allow…
3D geometryLAKE ICE MONITORING WITH WEBCAMS
Continuous monitoring of climate indicators is important for understanding the dynamics and trends of the climate system. Lake ice has been identified as one such indicator, and has been included in the list of Essential…
Change detection for remote sensing imagesLake Ice MonitoringRemote Sensing Image ClassificationSegmentation Of Remote Sensing Imagery+3Private Eye: On the Limits of Textual Screen Peeking via Eyeglass Reflections in Video Conferencing
Using mathematical modeling and human subjects experiments, this research explores the extent to which emerging webcams might leak recognizable textual and graphical information gleaming from eyeglass reflections capture…
4kMulti-Frame Super-ResolutionSuper-ResolutionAligning Across Large Gaps in Time
We present a method of temporally-invariant image registration for outdoor scenes, with invariance across time of day, across seasonal variations, and across decade-long periods, for low- and high-texture scenes. Our met…
3D ReconstructionImage RegistrationBuilding Dynamic Cloud Maps From the Ground Up
Satellite imagery of cloud cover is extremely important for understanding and predicting weather. We demonstrate how this imagery can be constructed "from the ground up" without requiring expensive geo-stationary satelli…