paper-with-me

Papers

Adaptive Multiplane Image Generation from a Single Internet Picture

2020-11-26 · Diogo C. Luvizon, Gustavo Sutter P. Carvalho, Andreza A. dos Santos, Jhonatas S. Conceicao, Jose L. Flores-Campana, Luis G. L. Decker, Marcos R. Souza, Helio Pedrini, Antonio Joia, Otavio A. B. Penatti

In the last few years, several works have tackled the problem of novel view synthesis from stereo images or even from a single picture. However, previous methods are computationally expensive, specially for high-resolution images. In this paper, we address the problem of generating a multiplane image (MPI) from a single high-resolution picture. We present the adaptive-MPI representation, which allows rendering novel views with low computational requirements. To this end, we propose an adaptive slicing algorithm that produces an MPI with a variable number of image planes. We present a new lightweight CNN for depth estimation, which is learned by knowledge distillation from a larger network. Occluded regions in the adaptive-MPI are inpainted also by a lightweight CNN. We show that our method is capable of producing high-quality predictions with one order of magnitude less parameters compared to previous approaches. The robustness of our method is evidenced on challenging pictures from the Internet.

📄 PDF Abstract BibTeX arXiv:2011.13317

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationImage GenerationKnowledge DistillationNovel View Synthesis

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

SAMPLING: Scene-adaptive Hierarchical Multiplane Images Representation for Novel View Synthesis from a Single Image

2023-09-12 · ICCV 2023 1 · Xiaoyu Zhou, Zhiwei Lin, Xiaojun Shan, Yongtao Wang 외

Recent novel view synthesis methods obtain promising results for relatively small scenes, e.g., indoor environments and scenes with a few objects, but tend to fail for unbounded outdoor scenes with a single image as inpu…

Novel View Synthesis

Learning multiplane images from single views with self-supervision

2021-10-18 · Gustavo Sutter P. Carvalho, Diogo C. Luvizon, Antonio Joia Neto, Andre G. C. Pacheco 외

Generating static novel views from an already captured image is a hard task in computer vision and graphics, in particular when the single input image has dynamic parts such as persons or moving objects. In this paper, w…

SinMPI: Novel View Synthesis from a Single Image with Expanded Multiplane Images

2023-12-18 · Guo Pu, Peng-Shuai Wang, Zhouhui Lian

Single-image novel view synthesis is a challenging and ongoing problem that aims to generate an infinite number of consistent views from a single input image. Although significant efforts have been made to advance the qu…

Novel View Synthesis

Tiled Multiplane Images for Practical 3D Photography

2023-09-25 · ICCV 2023 1 · Numair Khan, Douglas Lanman, Lei Xiao

The task of synthesizing novel views from a single image has useful applications in virtual reality and mobile computing, and a number of approaches to the problem have been proposed in recent years. A Multiplane Image (…

Single-View View Synthesis with Multiplane Images

2020-04-23 · CVPR 2020 6 · Richard Tucker, Noah Snavely

A recent strand of work in view synthesis uses deep learning to generate multiplane images (a camera-centric, layered 3D representation) given two or more input images at known viewpoints. We apply this representation to…