Learning to Detect Specular Highlights from Real-world Images
Specular highlight detection is a challenging problem, and has many applications such as shiny object detection and light source estimation. Although various highlight detection methods have been proposed, they fail to disambiguate bright material surfaces from highlights, and cannot handle non-white-balanced images. Moreover, at present, there is still no benchmark dataset for highlight detection. In this paper, we present a large-scale real-world highlight dataset containing a rich variety of material categories, with diverse highlight shapes and appearances, in which each image is with an annotated ground-truth mask. Based on the dataset, we develop a deep learning-based specular highlight detection network (SHDNet) leveraging multi-scale context contrasted features to accurately detect specular highlights of varying scales. In addition, we design a binary cross-entropy (BCE) loss and an intersection-over-union edge (IoUE) loss for our network. Compared with existing highlight detection methods, our method can accurately detect highlights of different sizes, while effectively excluding the non- highlight regions, such as bright materials, non-specular as well as colored lighting, and even light sources.
Code (0)
등록된 구현이 없습니다.
Tasks
Highlight Detectionobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
SpecSeg Network for Specular Highlight Detection and Segmentation in Real-World Images
Specular highlights detection and removal in images is a fundamental yet non-trivial problem of interest. Most modern techniques proposed are inadequate at dealing with real-world images taken under uncontrolled conditio…
Highlight DetectionSpecular SegmentationJoint network for specular highlight detection and adversarial generation of specular-free images trained with polarimetric data
Specular highlights in images pose a significant challenge in algorithms for image segmentation, object detection and other image-based decision-making systems. However, most systems ignore this particular scenario and n…
Decision MakingGenerative Adversarial NetworkHighlight Detectionhighlight removal+5LIGHTS: LIGHT Specularity Dataset for specular detection in Multi-view
Specular highlights are commonplace in images, however, methods for detecting them and in turn removing the phenomenon are particularly challenging. A reason for this, is due to the difficulty of creating a dataset for t…
Highlight DetectionA Multi-Task Network for Joint Specular Highlight Detection and Removal
Specular highlight detection and removal are fundamental and challenging tasks. Although recent methods achieve promising results on the two tasks by supervised training on synthetic training data, they are typically…
16kHighlight Detectionhighlight removalSingle-Image Specular Highlight Removal via Real-World Dataset Construction
Specular reflections pose great challenges on various multimedia and computer vision tasks, e.g. , image segmentation, detection and matching. In this paper, we build a large-scale Paired Specular-Diffuse (PSD) image dat…
Generative Adversarial NetworkHighlight Detectionhighlight removalImage Segmentation+1