paper-with-me

Papers

Structured Coupled Generative Adversarial Networks for Unsupervised Monocular Depth Estimation

2019-08-15 · Mihai Marian Puscas, Dan Xu, Andrea Pilzer, Nicu Sebe

Inspired by the success of adversarial learning, we propose a new end-to-end unsupervised deep learning framework for monocular depth estimation consisting of two Generative Adversarial Networks (GAN), deeply coupled with a structured Conditional Random Field (CRF) model. The two GANs aim at generating distinct and complementary disparity maps and at improving the generation quality via exploiting the adversarial learning strategy. The deep CRF coupling model is proposed to fuse the generative and discriminative outputs from the dual GAN nets. As such, the model implicitly constructs mutual constraints on the two network branches and between the generator and discriminator. This facilitates the optimization of the whole network for better disparity generation. Extensive experiments on the KITTI, Cityscapes, and Make3D datasets clearly demonstrate the effectiveness of the proposed approach and show superior performance compared to state of the art methods. The code and models are available at https://github.com/mihaipuscas/ 3dv---coupled-crf-disparity.

📄 PDF Abstract BibTeX arXiv:1908.05794

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationMonocular Depth EstimationUnsupervised Monocular Depth Estimation

Methods 이 논문이 사용한 방법론

CRF Conditional Random Fields or CRFs are a type of probabilistic graph model that take neighboring sample context into account for tasks like classification. Prediction is…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Masked GANs for Unsupervised Depth and Pose Prediction with Scale Consistency

2020-04-09 · Chaoqiang Zhao, Gary G. Yen, Qiyu Sun, Chongzhen Zhang 외

Previous work has shown that adversarial learning can be used for unsupervised monocular depth and visual odometry (VO) estimation, in which the adversarial loss and the geometric image reconstruction loss are utilized a…

Generative Adversarial NetworkImage ReconstructionPose PredictionTrajectory Prediction+1

Unsupervised Learning of Depth and Ego-Motion from Video

2017-04-25 · CVPR 2017 7 · Tinghui Zhou, Matthew Brown, Noah Snavely, David G. Lowe

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation ne…

Camera Pose EstimationDepth And Camera MotionDepth EstimationMotion Estimation+1

GANVO: Unsupervised Deep Monocular Visual Odometry and Depth Estimation with Generative Adversarial Networks

2018-09-16 · Yasin Almalioglu, Muhamad Risqi U. Saputra, Pedro P. B. de Gusmao, Andrew Markham 외

In the last decade, supervised deep learning approaches have been extensively employed in visual odometry (VO) applications, which is not feasible in environments where labelled data is not abundant. On the other hand, u…

Depth EstimationMonocular Visual OdometryPose EstimationVisual Odometry

Coupled CycleGAN: Unsupervised Hashing Network for Cross-Modal Retrieval

2019-03-06 · Chao Li, Cheng Deng, Lei Wang, De Xie 외

In recent years, hashing has attracted more and more attention owing to its superior capacity of low storage cost and high query efficiency in large-scale cross-modal retrieval. Benefiting from deep leaning, continuously…

Cross-Modal RetrievalRetrieval

Unsupervised Adversarial Depth Estimation using Cycled Generative Networks

2018-07-28 · Andrea Pilzer, Dan Xu, Mihai Marian Puscas, Elisa Ricci 외

While recent deep monocular depth estimation approaches based on supervised regression have achieved remarkable performance, costly ground truth annotations are required during training. To cope with this issue, in this …

Depth EstimationMonocular Depth Estimation