paper-with-me

Papers

Reconstructing Continuous Light Field From Single Coded Image

2023-11-16 · Yuya Ishikawa, Keita Takahashi, Chihiro Tsutake, Toshiaki Fujii

We propose a method for reconstructing a continuous light field of a target scene from a single observed image. Our method takes the best of two worlds: joint aperture-exposure coding for compressive light-field acquisition, and a neural radiance field (NeRF) for view synthesis. Joint aperture-exposure coding implemented in a camera enables effective embedding of 3-D scene information into an observed image, but in previous works, it was used only for reconstructing discretized light-field views. NeRF-based neural rendering enables high quality view synthesis of a 3-D scene from continuous viewpoints, but when only a single image is given as the input, it struggles to achieve satisfactory quality. Our method integrates these two techniques into an efficient and end-to-end trainable pipeline. Trained on a wide variety of scenes, our method can reconstruct continuous light fields accurately and efficiently without any test time optimization. To our knowledge, this is the first work to bridge two worlds: camera design for efficiently acquiring 3-D information and neural rendering.

📄 PDF Abstract BibTeX arXiv:2311.09646

Code (0)

등록된 구현이 없습니다.

Tasks

NeRFNeural Rendering

Similar Papers 제목 키워드 기반

Single View Refractive Index Tomography with Neural Fields

2023-09-08 · CVPR 2024 1 · Brandon Zhao, Aviad Levis, Liam Connor, Pratul P. Srinivasan 외

Refractive Index Tomography is the inverse problem of reconstructing the continuously-varying 3D refractive index in a scene using 2D projected image measurements. Although a purely refractive field is not directly visib…

3D Reconstruction

Learning Light Field Reconstruction from a Single Coded Image

2018-01-20 · Anil Kumar Vadathya, Saikiran Cholleti, Gautham Ramajayam, Vijayalakshmi Kanchana 외

Light field imaging is a rich way of representing the 3D world around us. However, due to limited sensor resolution capturing light field data inherently poses spatio-angular resolution trade-off. In this paper, we propo…

Dictionary LearningDisparity Estimation

Spectral Reconstruction and Disparity from Spatio-Spectrally Coded Light Fields via Multi-Task Deep Learning

2021-03-18 · Maximilian Schambach, Jiayang Shi, Michael Heizmann

We present a novel method to reconstruct a spectral central view and its aligned disparity map from spatio-spectrally coded light fields. Since we do not reconstruct an intermediate full light field from the coded measur…

compressed sensingDisparity EstimationSpectral Reconstruction

Compressive Light Field Reconstructions using Deep Learning

2018-02-05 · Mayank Gupta, Arjun Jauhari, Kuldeep Kulkarni, Suren Jayasuriya 외

Light field imaging is limited in its computational processing demands of high sampling for both spatial and angular dimensions. Single-shot light field cameras sacrifice spatial resolution to sample angular viewpoints, …

Compressive SensingDeep Learning

Fast Disparity Estimation from a Single Compressed Light Field Measurement

2022-09-22 · Emmanuel Martinez, Edwin Vargas, Henry Arguello

The abundant spatial and angular information from light fields has allowed the development of multiple disparity estimation approaches. However, the acquisition of light fields requires high storage and processing cost, …

Compressive SensingDisparity Estimation