S3Net: A Single Stream Structure for Depth Guided Image Relighting
Depth guided any-to-any image relighting aims to generate a relit image from the original image and corresponding depth maps to match the illumination setting of the given guided image and its depth map. To the best of our knowledge, this task is a new challenge that has not been addressed in the previous literature. To address this issue, we propose a deep learning-based neural Single Stream Structure network called S3Net for depth guided image relighting. This network is an encoder-decoder model. We concatenate all images and corresponding depth maps as the input and feed them into the model. The decoder part contains the attention module and the enhanced module to focus on the relighting-related regions in the guided images. Experiments performed on challenging benchmark show that the proposed model achieves the 3 rd highest SSIM in the NTIRE 2021 Depth Guided Any-to-any Relighting Challenge.
Code (1)
Tasks
DecoderImage RelightingSSIMSimilar Papers 제목 키워드 기반
Attention based Broadly Self-guided Network for Low light Image Enhancement
During the past years,deep convolutional neural networks have achieved impressive success in low-light Image Enhancement.Existing deep learning methods mostly enhance the ability of feature extraction by stacking network…
Image EnhancementLow-Light Image EnhancementStructure-Guided Ranking Loss for Single Image Depth Prediction
Single image depth prediction is a challenging task due to its ill-posed nature and challenges with capturing ground truth for supervision. Large-scale disparity data generated from stereo photos and 3D videos is a promi…
Depth EstimationDepth PredictionMonocular Depth EstimationPrediction3dDepthNet: Point Cloud Guided Depth Completion Network for Sparse Depth and Single Color Image
In this paper, we propose an end-to-end deep learning network named 3dDepthNet, which produces an accurate dense depth image from a single pair of sparse LiDAR depth and color image for robotics and autonomous driving ta…
Autonomous DrivingDecoderDepth CompletionPoint Cloud CompletionSG-MIM: Structured Knowledge Guided Efficient Pre-training for Dense Prediction
Masked Image Modeling (MIM) techniques have redefined the landscape of computer vision, enabling pre-trained models to achieve exceptional performance across a broad spectrum of tasks. Despite their success, the full pot…
Depth EstimationMonocular Depth EstimationRepresentation LearningSemantic SegmentationSGTBN: Generating Dense Depth Maps from Single-Line LiDAR
Depth completion aims to generate a dense depth map from the sparse depth map and aligned RGB image. However, current depth completion methods use extremely expensive 64-line LiDAR(about $100,000) to obtain sparse depth …
3D geometryDepth CompletionDepth EstimationMonocular Depth Estimation