Unpaired Single-Image Depth Synthesis with cycle-consistent Wasserstein GANs
Real-time estimation of actual environment depth is an essential module for various autonomous system tasks such as localization, obstacle detection and pose estimation. During the last decade of machine learning, extensive deployment of deep learning methods to computer vision tasks yielded successful approaches for realistic depth synthesis out of a simple RGB modality. While most of these models rest on paired depth data or availability of video sequences and stereo images, there is a lack of methods facing single-image depth synthesis in an unsupervised manner. Therefore, in this study, latest advancements in the field of generative neural networks are leveraged to fully unsupervised single-image depth synthesis. To be more exact, two cycle-consistent generators for RGB-to-depth and depth-to-RGB transfer are implemented and simultaneously optimized using the Wasserstein-1 distance. To ensure plausibility of the proposed method, we apply the models to a self acquised industrial data set as well as to the renown NYU Depth v2 data set, which allows comparison with existing approaches. The observed success in this study suggests high potential for unpaired single-image depth estimation in real world applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationPose EstimationSimilar Papers 제목 키워드 기반
Unpaired Brain MR-to-CT Synthesis using a Structure-Constrained CycleGAN
The cycleGAN is becoming an influential method in medical image synthesis. However, due to a lack of direct constraints between input and synthetic images, the cycleGAN cannot guarantee structural consistency between the…
Image GenerationPositionSelf-Augmented Unpaired Image Dehazing via Density and Depth Decomposition
To overcome the overfitting issue of dehazing models trained on synthetic hazy-clean image pairs, many recent methods attempted to improve models' generalization ability by training on unpaired data. Most of them sim…
Image DehazingDC-cycleGAN: Bidirectional CT-to-MR Synthesis from Unpaired Data
Magnetic resonance (MR) and computer tomography (CT) images are two typical types of medical images that provide mutually-complementary information for accurate clinical diagnosis and treatment. However, obtaining both i…
Image GenerationSSIMCross-modality image synthesis from unpaired data using CycleGAN: Effects of gradient consistency loss and training data size
CT is commonly used in orthopedic procedures. MRI is used along with CT to identify muscle structures and diagnose osteonecrosis due to its superior soft tissue contrast. However, MRI has poor contrast for bone structure…
Image GenerationUnsupervised Single Image Underwater Depth Estimation
Depth estimation from a single underwater image is one of the most challenging problems and is highly ill-posed. Due to the absence of large generalized underwater depth datasets and the difficulty in obtaining ground tr…
Depth Estimation