Deep Domain Adversarial Adaptation for Photon-efficient Imaging
Photon-efficient imaging with the single-photon light detection and ranging (LiDAR) captures the three-dimensional (3D) structure of a scene by only a few detected signal photons per pixel. However, the existing computational methods for photon-efficient imaging are pre-tuned on a restricted scenario or trained on simulated datasets. When applied to realistic scenarios whose signal-to-background ratios (SBR) and other hardware-specific properties differ from those of the original task, the model performance often significantly deteriorates. In this paper, we present a domain adversarial adaptation design to alleviate this domain shift problem by exploiting unlabeled real-world data, with significant resource savings. This method demonstrates superior performance on simulated and real-world experiments using our home-built up-conversion single-photon imaging system, which provides an efficient approach to bypass the lack of ground-truth depth information in implementing computational imaging algorithms for realistic applications.
Code (2)
Tasks
Domain AdaptationSimilar Papers 제목 키워드 기반
Poisson noise reduction with non-local PCA
Photon-limited imaging arises when the number of photons collected by a sensor array is small relative to the number of detector elements. Photon limitations are an important concern for many applications such as spectra…
AstronomyDenoisingDictionary LearningDual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution
Due to the sophisticated imaging process, an identical scene captured by different cameras could exhibit distinct imaging patterns, introducing distinct proficiency among the super-resolution (SR) models trained on image…
Domain AdaptationImage Super-ResolutionSuper-ResolutionUnsupervised Domain AdaptationUnsupervised domain adaptation in brain lesion segmentation with adversarial networks
Significant advances have been made towards building accurate automatic segmentation systems for a variety of biomedical applications using machine learning. However, the performance of these systems often degrades when …
Domain AdaptationLesion SegmentationSegmentationUnsupervised Domain AdaptationSoDaCam: Software-defined Cameras via Single-Photon Imaging
Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acqui…
Photon Inhibition for Energy-Efficient Single-Photon Imaging
Single-photon cameras (SPCs) are emerging as sensors of choice for various challenging imaging applications. One class of SPCs based on the single-photon avalanche diode (SPAD) detects individual photons using an avalanc…
Edge DetectionImage Reconstruction