PhIT-Net: Photo-consistent Image Transform for Robust Illumination Invariant Matching
We propose a new and completely data-driven approach for generating a photo-consistent image transform. We show that simple classical algorithms which operate in the transform domain become extremely resilient to illumination changes. This considerably improves matching accuracy, outperforming the use of state-of-the-art invariant representations as well as new matching methods based on deep features. The transform is obtained by training a neural network with a specialized triplet loss, designed to emphasize actual scene changes while attenuating illumination changes. The transform yields an illumination invariant representation, structured as an image map, which is highly flexible and can be easily used for various tasks.
Code (2)
Tasks
TripletSimilar Papers 제목 키워드 기반
Learning Flow-based Feature Warping for Face Frontalization with Illumination Inconsistent Supervision
Despite recent advances in deep learning-based face frontalization methods, photo-realistic and illumination preserving frontal face synthesis is still challenging due to large pose and illumination discrepancy during tr…
Face GenerationImage GenerationGRAPHITE: Generating Automatic Physical Examples for Machine-Learning Attacks on Computer Vision Systems
This paper investigates an adversary's ease of attack in generating adversarial examples for real-world scenarios. We address three key requirements for practical attacks for the real-world: 1) automatically constraining…
BIG-bench Machine LearningGeneral ClassificationLicense Plate RecognitionUltra-low-light computer vision using trained photon correlations
Illumination using correlated photon sources has been established as an approach to allowing high-fidelity images to be reconstructed from noisy camera frames by taking advantage of the knowledge that signal photons are …
Image ReconstructionObject RecognitionRobust Point Light Source Estimation Using Differentiable Rendering
Illumination estimation is often used in mixed reality to re-render a scene from another point of view, to change the color/texture of an object, or to insert a virtual object consistently lit into a real video or photog…
Mixed RealityObjectOutdoor Light Source EstimationRetrievalP2GS: Physical Prior-guided Gaussian Splatting for Photometrically Consistent Urban Reconstruction
3D Gaussian Splatting (3DGS) has recently emerged as a powerful explicit representation enabling fast, high-fidelity rendering, making it a promising foundation for closed-loop simulators and perception models in autonom…
Autonomous Driving