RenDetNet: Weakly-supervised Shadow Detection with Shadow Caster Verification
Existing shadow detection models struggle to differentiate dark image areas from shadows. In this paper, we tackle this issue by verifying that all detected shadows are real, i.e. they have paired shadow casters. We perform this step in a physically-accurate manner by differentiably re-rendering the scene and observing the changes stemming from carving out estimated shadow casters. Thanks to this approach, the RenDetNet proposed in this paper is the first learning-based shadow detection model whose supervisory signals can be computed in a self-supervised manner. The developed system compares favourably against recent models trained on our data. As part of this publication, we release our code on github.
Code (1)
Tasks
Shadow DetectionSimilar Papers 제목 키워드 기반
UnShadowNet: Illumination Critic Guided Contrastive Learning For Shadow Removal
Shadows are frequently encountered natural phenomena that significantly hinder the performance of computer vision perception systems in practical settings, e.g., autonomous driving. A solution to this would be to elimina…
Autonomous DrivingContrastive LearningShadow RemovalLearning Shadow Correspondence for Video Shadow Detection
Video shadow detection aims to generate consistent shadow predictions among video frames. However, the current approaches suffer from inconsistent shadow predictions across frames, especially when the illumination and ba…
Shadow DetectionVideo Shadow DetectionCross-Modal Spherical Aggregation for Weakly Supervised Remote Sensing Shadow Removal
Remote sensing shadow removal, which aims to recover contaminated surface information, is tricky since shadows typically display overwhelmingly low illumination intensities. In contrast, the infrared image is robust towa…
Shadow RemovalWeakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging
Detecting acoustic shadows in ultrasound images is important in many clinical and engineering applications. Real-time feedback of acoustic shadows can guide sonographers to a standardized diagnostic viewing plane with mi…
Diagnosticimage-classificationImage ClassificationSegmentation+1deSEO: Physics-Aware Dataset Creation for High-Resolution Satellite Image Shadow Removal
Shadows cast by terrain and tall structures remain a major obstacle for high-resolution satellite image analysis, degrading classification, detection, and 3D reconstruction performance. Public resources offering geometry…
Image Shadow Removal3D ReconstructionShadow Detection