PhaseCam3D — Learning Phase Masks for Passive Single View Depth Estimation
3DImaging is critical for a myriad of applications such as autonomous driving, robotics, virtual reality, and surveillance. The current state of art relies on active illumination based techniques such as LIDAR, radar, structured illumination or continuous-wave time-of-flight. However, many emerging applications, especially on mobile platforms, are severely power and energy constrained. Active approaches are unlikely to scale well for these applications and hence, there is a pressing need for robust passive 3D imaging technologies. Multi-camera systems provide state of the art performance for passive 3D imaging. In these systems, triangulation between corresponding points on multiple views of the scene allows for 3D estimation. Stereo and multi-view stereo approaches meet some of the needs mentioned above, and an increasing number of mobile platforms have been adopting such technology. Unfortunately, having multiple cameras within a single platform results in increased system cost as well as implementation complexity. The principal goal of this paper is to develop a passive, single-viewpoint 3D imaging system. We exploit the emerging computational imaging paradigm, wherein the optics and the computational algorithm are co-designed to maximize performance within operational constraints.
Code (1)
Tasks
Autonomous DrivingDepth EstimationMonocular Depth EstimationSimilar Papers 제목 키워드 기반
HAMON: Passive Optical Sequence Mixing for Long-Horizon Forecasting
Simple linear and frequency-domain models remain surprisingly competitive in long-horizon time-series forecasting, and recent mechanistic evidence suggests that standard forecasting benchmarks may not require the dense s…
Lifelong Matrix Completion with Sparsity-Number
Matrix completion problem has been previously studied under various adaptive and passive settings. Previously, researchers have proposed passive, two-phase and single-phase algorithms using coherence parameter, and multi…
Matrix CompletionEfficient 3D Instance Mapping and Localization with Neural Fields
We tackle the problem of learning an implicit scene representation for 3D instance segmentation from a sequence of posed RGB images. Towards this, we introduce 3DIML, a novel framework that efficiently learns a neural la…
3D Instance SegmentationImage SegmentationInstance SegmentationScene Understanding+2Coded Aperture Radar Imaging Using Reconfigurable Intelligent Surfaces
In this paper, we focus on radar imaging using active sensing with a single transceiver and reconfigurable intelligent surface (RIS). RISs are arrays with tunable passive phase shifter elements that can modify the propag…
Compressive SensingAccurate Human Body Reconstruction for Volumetric Video
In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate de…
Stereo MatchingVideo Reconstruction