Dim the Lights! -- Low-Rank Prior Temporal Data for Specular-Free Video Recovery
The appearance of an object is significantly affected by the illumination conditions in the environment. This is more evident with strong reflective objects as they suffer from more dominant specular reflections, causing information loss and discontinuity in the image domain. In this paper, we present a novel framework for specular-free video recovery with special emphasis on dealing with complex motions coming from objects or camera. Our solution is a twostep approach that allows for both detection and restoration of the damaged regions on video data. We first propose a spatially adaptive detection term that searches for the damage areas. We then introduce a variational solution for specular-free video recovery that allows exploiting spatio-temporal correlations by representing prior data in a low-rank form. We demonstrate that our solution prevents major drawbacks of existing approaches while improving the performance in both detection accuracy and inpainting quality. Finally, we show that our approach can be applied to other problems such as object removal.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
LIGHTS: LIGHT Specularity Dataset for specular detection in Multi-view
Specular highlights are commonplace in images, however, methods for detecting them and in turn removing the phenomenon are particularly challenging. A reason for this, is due to the difficulty of creating a dataset for t…
Highlight DetectionA Temporal Learning Approach to Inpainting Endoscopic Specularities and Its effect on Image Correspondence
Video streams are utilised to guide minimally-invasive surgery and diagnostic procedures in a wide range of procedures, and many computer assisted techniques have been developed to automatically analyse them. These appro…
3D Reconstruction3D Shape ModelingAnatomyDiagnostic+5Learning to Remove Wrinkled Transparent Film with Polarized Prior
In this paper, we study a new problem, Film Removal (FR), which attempts to remove the interference of wrinkled transparent films and reconstruct the original information under films for industrial recognition systems. W…
Film RemovalSeeing Temporal Modulation of Lights From Standard Cameras
In this paper, we propose a novel method for measuring the temporal modulation of lights by using off-the-shelf cameras. In particular, we show that the invisible flicker patterns of various lights such as fluorescent li…
DeblurringEstimating Reflectance Layer from A Single Image: Integrating Reflectance Guidance and Shadow/Specular Aware Learning
Estimating the reflectance layer from a single image is a challenging task. It becomes more challenging when the input image contains shadows or specular highlights, which often render an inaccurate estimate of the refle…
highlight removalIntrinsic Image DecompositionShadow Removal