Pixel-wise Guidance for Utilizing Auxiliary Features in Monte Carlo Denoising
Auxiliary features such as geometric buffers (G-buffers) and path descriptors (P-buffers) have been shown to significantly improve Monte Carlo (MC) denoising. However, recent approaches implicitly learn to exploit auxiliary features for denoising, which could lead to insufficient utilization of each type of auxiliary features. To overcome such an issue, we propose a denoising framework that relies on an explicit pixel-wise guidance for utilizing auxiliary features. First, we train two denoisers, each trained by a different auxiliary feature (i.e., G-buffers or P-buffers). Then we design our ensembling network to obtain per-pixel ensembling weight maps, which represent pixel-wise guidance for which auxiliary feature should be dominant at reconstructing each individual pixel and use them to ensemble the two denoised results of our denosiers. We also propagate our pixel-wise guidance to the denoisers by jointly training the denoisers and the ensembling network, further guiding the denoisers to focus on regions where G-buffers or P-buffers are relatively important for denoising. Our result and show considerable improvement in denoising performance compared to the baseline denoising model using both G-buffers and P-buffers.
Code (1)
Tasks
DenoisingSimilar Papers 제목 키워드 기반
PL-UNeXt: Per-stage Edge Detail and Line Feature Guided Segmentation for Power Line Detection
Power line detection is a critical inspection task for electricity companies and is also useful in avoiding drone obstacles. Accurately separating power lines from the surrounding area in the aerial image is still challe…
Line DetectionSegmentationSelf-produced Guidance for Weakly-supervised Object Localization
Weakly supervised methods usually generate localization results based on attention maps produced by classification networks. However, the attention maps exhibit the most discriminative parts of the object which are small…
ClassificationGeneral ClassificationObjectObject Localization+1W-PoseNet: Dense Correspondence Regularized Pixel Pair Pose Regression
Solving 6D pose estimation is non-trivial to cope with intrinsic appearance and shape variation and severe inter-object occlusion, and is made more challenging in light of extrinsic large illumination changes and low qua…
6D Pose Estimation6D Pose Estimation using RGBDPose EstimationregressionFine-grained Image Editing by Pixel-wise Guidance Using Diffusion Models
Our goal is to develop fine-grained real-image editing methods suitable for real-world applications. In this paper, we first summarize four requirements for these methods and propose a novel diffusion-based image editing…
Semantic SegmentationPyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop
Regression-based methods have recently shown promising results in reconstructing human meshes from monocular images. By directly mapping raw pixels to model parameters, these methods can produce parametric models in a fe…
3D human pose and shape estimation3D Human Pose Estimation3D Human ReconstructionHuman Mesh Recovery+1