paper-with-me

홈 › Papers

Fast View Synthesis with Deep Stereo Vision

2018-04-25 · Tewodros Habtegebrial, Kiran varanasi, Christian Bailer, Didier Stricker

Novel view synthesis is an important problem in computer vision and graphics. Over the years a large number of solutions have been put forward to solve the problem. However, the large-baseline novel view synthesis problem is far from being "solved". Recent works have attempted to use Convolutional Neural Networks (CNNs) to solve view synthesis tasks. Due to the difficulty of learning scene geometry and interpreting camera motion, CNNs are often unable to generate realistic novel views. In this paper, we present a novel view synthesis approach based on stereo-vision and CNNs that decomposes the problem into two sub-tasks: view dependent geometry estimation and texture inpainting. Both tasks are structured prediction problems that could be effectively learned with CNNs. Experiments on the KITTI Odometry dataset show that our approach is more accurate and significantly faster than the current state-of-the-art. The code and supplementary material will be publicly available. Results could be found here https://youtu.be/5pzS9jc-5t0

📄 PDF Abstract BibTeX arXiv:1804.09690

Code (0)

등록된 구현이 없습니다.

Tasks

Novel View SynthesisStructured Prediction

Similar Papers 제목 키워드 기반

Fast Depth Estimation for View Synthesis

2020-03-14 · Nantheera Anantrasirichai, Majid Geravand, David Braendler, David R. Bull

Disparity/depth estimation from sequences of stereo images is an important element in 3D vision. Owing to occlusions, imperfect settings and homogeneous luminance, accurate estimate of depth remains a challenging problem…

DecoderDepth Estimation

Generalizable Novel-View Synthesis using a Stereo Camera

2024-04-21 · CVPR 2024 1 · Haechan Lee, Wonjoon Jin, Seung-Hwan Baek, Sunghyun Cho

In this paper, we propose the first generalizable view synthesis approach that specifically targets multi-view stereo-camera images. Since recent stereo matching has demonstrated accurate geometry prediction, we introduc…

Generalizable Novel View SynthesisNeRFNovel View SynthesisStereo Matching

Single-View View Synthesis with Self-Rectified Pseudo-Stereo

2023-04-19 · Yang Zhou, Hanjie Wu, Wenxi Liu, Zheng Xiong 외

Synthesizing novel views from a single view image is a highly ill-posed problem. We discover an effective solution to reduce the learning ambiguity by expanding the single-view view synthesis problem to a multi-view sett…

3D ReconstructionNovel View Synthesis

NeuralMVS: Bridging Multi-View Stereo and Novel View Synthesis

2021-08-09 · Radu Alexandru Rosu, Sven Behnke

Multi-View Stereo (MVS) is a core task in 3D computer vision. With the surge of novel deep learning methods, learned MVS has surpassed the accuracy of classical approaches, but still relies on building a memory intensive…

NeRFNovel View Synthesis

MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo

2024-05-20 · Tianqi Liu, Guangcong Wang, Shoukang Hu, Liao Shen 외

We present MVSGaussian, a new generalizable 3D Gaussian representation approach derived from Multi-View Stereo (MVS) that can efficiently reconstruct unseen scenes. Specifically, 1) we leverage MVS to encode geometry-awa…

NeRFNovel View Synthesis