Intrinsic Light Field Images
We present a method to automatically decompose a light field into its intrinsic shading and albedo components. Contrary to previous work targeted to 2D single images and videos, a light field is a 4D structure that captures non-integrated incoming radiance over a discrete angular domain. This higher dimensionality of the problem renders previous state-of-the-art algorithms impractical either due to their cost of processing a single 2D slice, or their inability to enforce proper coherence in additional dimensions. We propose a new decomposition algorithm that jointly optimizes the whole light field data for proper angular coherence. For efficiency, we extend Retinex theory, working on the gradient domain, where new albedo and occlusion terms are introduced. Results show our method provides 4D intrinsic decompositions difficult to achieve with previous state-of-the-art algorithms. We further provide a comprehensive analysis and comparisons with existing intrinsic image/video decomposition methods on light field images.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
IBL-NeRF: Image-Based Lighting Formulation of Neural Radiance Fields
We propose IBL-NeRF, which decomposes the neural radiance fields (NeRF) of large-scale indoor scenes into intrinsic components. Recent approaches further decompose the baked radiance of the implicit volume into intrinsic…
Inverse RenderingNeRFLight Field Intrinsics With a Deep Encoder-Decoder Network
We present a fully convolutional autoencoder for light fields, which jointly encodes stacks of horizontal and vertical epipolar plane images through a deep network of residual layers. The complex structure of the light f…
DecoderDisparity EstimationLightfieldLearning Light Field Angular Super-Resolution via a Geometry-Aware Network
The acquisition of light field images with high angular resolution is costly. Although many methods have been proposed to improve the angular resolution of a sparsely-sampled light field, they always focus on the light f…
Depth EstimationSuper-ResolutionNeural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes
Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D recon…
3D ReconstructionInverse RenderingNeRFNeural Fields Meet Explicit Geometric Representations for Inverse Rendering of Urban Scenes
Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D r…
3D ReconstructionInverse RenderingNeRF