From Shadow Segmentation to Shadow Removal
The requirement for paired shadow and shadow-free images limits the size and diversity of shadow removal datasets and hinders the possibility of training large-scale, robust shadow removal algorithms. We propose a shadow removal method that can be trained using only shadow and non-shadow patches cropped from the shadow images themselves. Our method is trained via an adversarial framework, following a physical model of shadow formation. Our central contribution is a set of physics-based constraints that enables this adversarial training. Our method achieves competitive shadow removal results compared to state-of-the-art methods that are trained with fully paired shadow and shadow-free images. The advantages of our training regime are even more pronounced in shadow removal for videos. Our method can be fine-tuned on a testing video with only the shadow masks generated by a pre-trained shadow detector and outperforms state-of-the-art methods on this challenging test. We illustrate the advantages of our method on our proposed video shadow removal dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversitySegmentationShadow RemovalSimilar Papers 제목 키워드 기반
Shadow Removal Refinement via Material-Consistent Shadow Edges
Shadow boundaries can be confused with material boundaries as both exhibit sharp changes in luminance or contrast within a scene. However, shadows do not modify the intrinsic color or texture of surfaces. Therefore, on b…
Image SegmentationSegmentationSemantic SegmentationShadow RemovalWavShadow: Wavelet Based Shadow Segmentation and Removal
Shadow removal and segmentation remain challenging tasks in computer vision, particularly in complex real world scenarios. This study presents a novel approach that enhances the ShadowFormer model by incorporating Masked…
Edge DetectionSegmentationShadow RemovalDeshadow-Anything: When Segment Anything Model Meets Zero-shot shadow removal
Segment Anything (SAM), an advanced universal image segmentation model trained on an expansive visual dataset, has set a new benchmark in image segmentation and computer vision. However, it faced challenges when it came …
Image RestorationImage SegmentationImage Shadow RemovalSegmentation+2ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformer
Shadow-affected images often exhibit pronounced spatial discrepancies in color and illumination, consequently degrading various vision applications including object detection and segmentation systems. To effectively elim…
Image Shadow Removalobject-detectionObject DetectionRepresentation Learning+1From Shadow Generation to Shadow Removal
Shadow removal is a computer-vision task that aims to restore the image content in shadow regions. While almost all recent shadow-removal methods require shadow-free images for training, in ECCV 2020 Le and Samaras intro…
Shadow Removal