paper-with-me

홈 › Papers

Tiled Multiplane Images for Practical 3D Photography

2023-09-25 · ICCV 2023 1 · Numair Khan, Douglas Lanman, Lei Xiao

The task of synthesizing novel views from a single image has useful applications in virtual reality and mobile computing, and a number of approaches to the problem have been proposed in recent years. A Multiplane Image (MPI) estimates the scene as a stack of RGBA layers, and can model complex appearance effects, anti-alias depth errors and synthesize soft edges better than methods that use textured meshes or layered depth images. And unlike neural radiance fields, an MPI can be efficiently rendered on graphics hardware. However, MPIs are highly redundant and require a large number of depth layers to achieve plausible results. Based on the observation that the depth complexity in local image regions is lower than that over the entire image, we split an MPI into many small, tiled regions, each with only a few depth planes. We call this representation a Tiled Multiplane Image (TMPI). We propose a method for generating a TMPI with adaptive depth planes for single-view 3D photography in the wild. Our synthesized results are comparable to state-of-the-art single-view MPI methods while having lower computational overhead.

📄 PDF Abstract BibTeX arXiv:2309.14291

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Compact and adaptive multiplane images for view synthesis

2021-02-19 · Julia Navarro, Neus Sabater

Recently, learning methods have been designed to create Multiplane Images (MPIs) for view synthesis. While MPIs are extremely powerful and facilitate high quality renderings, a great amount of memory is required, making …

Cross-MPI: Cross-scale Stereo for Image Super-Resolution using Multiplane Images

2020-11-30 · CVPR 2021 1 · Yuemei Zhou, Gaochang Wu, Ying Fu, Kun Li 외

Various combinations of cameras enrich computational photography, among which reference-based superresolution (RefSR) plays a critical role in multiscale imaging systems. However, existing RefSR approaches fail to accomp…

Image Super-ResolutionSuper-Resolution

MultiPlaneNeRF: Neural Radiance Field with Non-Trainable Representation

2023-05-17 · Dominik Zimny, Artur Kasymov, Adam Kania, Jacek Tabor 외

NeRF is a popular model that efficiently represents 3D objects from 2D images. However, vanilla NeRF has some important limitations. NeRF must be trained on each object separately. The training time is long since we enco…

DecoderNeRF

SinMPI: Novel View Synthesis from a Single Image with Expanded Multiplane Images

2023-12-18 · Guo Pu, Peng-Shuai Wang, Zhouhui Lian

Single-image novel view synthesis is a challenging and ongoing problem that aims to generate an infinite number of consistent views from a single input image. Although significant efforts have been made to advance the qu…

Novel View Synthesis

Single-View View Synthesis with Multiplane Images

2020-04-23 · CVPR 2020 6 · Richard Tucker, Noah Snavely

A recent strand of work in view synthesis uses deep learning to generate multiplane images (a camera-centric, layered 3D representation) given two or more input images at known viewpoints. We apply this representation to…