Instance Shadow Detection with A Single-Stage Detector
This paper formulates a new problem, instance shadow detection, which aims to detect shadow instance and the associated object instance that cast each shadow in the input image. To approach this task, we first compile a new dataset with the masks for shadow instances, object instances, and shadow-object associations. We then design an evaluation metric for quantitative evaluation of the performance of instance shadow detection. Further, we design a single-stage detector to perform instance shadow detection in an end-to-end manner, where the bidirectional relation learning module and the deformable maskIoU head are proposed in the detector to directly learn the relation between shadow instances and object instances and to improve the accuracy of the predicted masks. Finally, we quantitatively and qualitatively evaluate our method on the benchmark dataset of instance shadow detection and show the applicability of our method on light direction estimation and photo editing.
Code (2)
Tasks
Instance Shadow DetectionObjectRelationShadow DetectionSimilar Papers 제목 키워드 기반
Single-Stage Instance Shadow Detection with Bidirectional Relation Learning
Instance shadow detection aims to find shadow instances paired with the objects that cast the shadows. The previous work adopts a two-stage framework to first predict shadow instances, object instances, and shadow-object…
Instance Shadow DetectionObjectRelationShadow DetectionVideo Instance Shadow Detection Under the Sun and Sky
Instance shadow detection, crucial for applications such as photo editing and light direction estimation, has undergone significant advancements in predicting shadow instances, object instances, and their associations. T…
Contrastive LearningInstance Shadow DetectionObjectShadow Detection+1Shadow Detection With Conditional Generative Adversarial Networks
We introduce scGAN, a novel extension of conditional Generative Adversarial Networks (GAN) tailored for the challenging problem of shadow detection in images. Previous methods for shadow detection focus on learning the l…
SensitivityShadow DetectionSingle-Stage Object Detection from Top-View Grid Maps on Custom Sensor Setups
We present our approach to unsupervised domain adaptation for single-stage object detectors on top-view grid maps in automated driving scenarios. Our goal is to train a robust object detector on grid maps generated from …
Domain AdaptationObjectobject-detectionObject Detection+1Triple-cooperative Video Shadow Detection
Shadow detection in a single image has received significant research interest in recent years. However, much fewer works have been explored in shadow detection over dynamic scenes. The bottleneck is the lack of a well-es…
Saliency DetectionSemantic SegmentationShadow DetectionVideo Object Segmentation+2