paper-with-me

홈 › Papers

Bayesian View Synthesis and Image-Based Rendering Principles

2014-06-01 · CVPR 2014 6 · Sergi Pujades, Frederic Devernay, Bastian Goldluecke

In this paper, we address the problem of synthesizing novel views from a set of input images. State of the art methods, such as the Unstructured Lumigraph, have been using heuristics to combine information from the original views, often using an explicit or implicit approximation of the scene geometry. While the proposed heuristics have been largely explored and proven to work effectively, a Bayesian formulation was recently introduced, formalizing some of the previously proposed heuristics, pointing out which physical phenomena could lie behind each. However, some important heuristics were still not taken into account and lack proper formalization. We contribute a new physics-based generative model and the corresponding Maximum a Posteriori estimate, providing the desired unification between heuristics-based methods and a Bayesian formulation. The key point is to systematically consider the error induced by the uncertainty in the geometric proxy. We provide an extensive discussion, analyzing how the obtained equations explain the heuristics developed in previous methods. Furthermore, we show that our novel Bayesian model significantly improves the quality of novel views, in particular if the scene geometry estimate is inaccurate.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Methods and strategies for improving the novel view synthesis quality of neural radiation field

2024-01-23 · Shun Fang, Ming Cui, Xing Feng, Yanna Lv

Neural Radiation Field (NeRF) technology can learn a 3D implicit model of a scene from 2D images and synthesize realistic novel view images. This technology has received widespread attention from the industry and has goo…

NeRFNovel View Synthesis

Nonparametric Bayesian Texture Learning and Synthesis

2009-12-01 · NeurIPS 2009 12 · Long Zhu, Yuanahao Chen, Bill Freeman, Antonio Torralba

We present a nonparametric Bayesian method for texture learning and synthesis. A texture image is represented by a 2D-Hidden Markov Model (2D-HMM) where the hidden states correspond to the cluster labeling of textons an…

Image SegmentationSemantic SegmentationTexture Synthesis

ProbNVS: Fast Novel View Synthesis with Learned Probability-Guided Sampling

2022-04-07 · Yuemei Zhou, Tao Yu, Zerong Zheng, Ying Fu 외

Existing state-of-the-art novel view synthesis methods rely on either fairly accurate 3D geometry estimation or sampling of the entire space for neural volumetric rendering, which limit the overall efficiency. In order t…

3D geometryNovel View Synthesis

Lighting Every Darkness with 3DGS: Fast Training and Real-Time Rendering for HDR View Synthesis

2024-06-10 · Xin Jin, Pengyi Jiao, Zheng-Peng Duan, Xingchao Yang 외

Volumetric rendering based methods, like NeRF, excel in HDR view synthesis from RAWimages, especially for nighttime scenes. While, they suffer from long training times and cannot perform real-time rendering due to dense …

2k3DGSNeRFNovel View Synthesis+1

Semantic View Synthesis

2020-08-24 · ECCV 2020 8 · Hsin-Ping Huang, Hung-Yu Tseng, Hsin-Ying Lee, Jia-Bin Huang

We tackle a new problem of semantic view synthesis -- generating free-viewpoint rendering of a synthesized scene using a semantic label map as input. We build upon recent advances in semantic image synthesis and view syn…

Image Generation