Deep Photon Mapping
Recently, deep learning-based denoising approaches have led to dramatic improvements in low sample-count Monte Carlo rendering. These approaches are aimed at path tracing, which is not ideal for simulating challenging light transport effects like caustics, where photon mapping is the method of choice. However, photon mapping requires very large numbers of traced photons to achieve high-quality reconstructions. In this paper, we develop the first deep learning-based method for particle-based rendering, and specifically focus on photon density estimation, the core of all particle-based methods. We train a novel deep neural network to predict a kernel function to aggregate photon contributions at shading points. Our network encodes individual photons into per-photon features, aggregates them in the neighborhood of a shading point to construct a photon local context vector, and infers a kernel function from the per-photon and photon local context features. This network is easy to incorporate in many previous photon mapping methods (by simply swapping the kernel density estimator) and can produce high-quality reconstructions of complex global illumination effects like caustics with an order of magnitude fewer photons compared to previous photon mapping methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingDensity EstimationSimilar Papers 제목 키워드 기반
From Particles to Fields: Reframing Photon Mapping with Continuous Gaussian Photon Fields
Accurately modeling light transport is essential for realistic image synthesis. Photon mapping provides physically grounded estimates of complex global illumination effects such as caustics and specular-diffuse interacti…
OptiLookUp: An Optical ROM-Based Lookup Table Engine for Photonic Accelerators
Read-only memory (ROM) provides deterministic access to predefined data mappings. Extending ROM concepts to the optical domain enables high-bandwidth, low-latency, and parallel memory access, but realizing compact and re…
Map Optical Properties to Subwavelength Structures Directly via a Diffusion Model
Subwavelength photonic structures and metamaterials provide revolutionary approaches for controlling light. The inverse design methods proposed for these subwavelength structures are vital to the development of new photo…
Ultrafast High-Flux Single-Photon LiDAR Simulator via Neural Mapping
Efficient simulation of photon registrations in single-photon LiDAR (SPL) is essential for applications such as depth estimation under high-flux conditions, where hardware dead time significantly distorts photon measurem…
Depth EstimationTwo-photon photoactivated voltage imaging in tissue with an Archaerhodopsin-derived reporter
Robust voltage imaging in tissue remains a technical challenge. Existing combinations of genetically encoded voltage indicators (GEVIs) and microscopy techniques cannot simultaneously achieve sufficiently high voltage se…