Zero-Shot Day-Night Domain Adaptation with a Physics Prior
We explore the zero-shot setting for day-night domain adaptation. The traditional domain adaptation setting is to train on one domain and adapt to the target domain by exploiting unlabeled data samples from the test set. As gathering relevant test data is expensive and sometimes even impossible, we remove any reliance on test data imagery and instead exploit a visual inductive prior derived from physics-based reflection models for domain adaptation. We cast a number of color invariant edge detectors as trainable layers in a convolutional neural network and evaluate their robustness to illumination changes. We show that the color invariant layer reduces the day-night distribution shift in feature map activations throughout the network. We demonstrate improved performance for zero-shot day to night domain adaptation on both synthetic as well as natural datasets in various tasks, including classification, segmentation and place recognition.
Code (1)
Tasks
Domain AdaptationImage RetrievalSemantic SegmentationSimilar Papers 제목 키워드 기반
Similarity Min-Max: Zero-Shot Day-Night Domain Adaptation
Low-light conditions not only hamper human visual experience but also degrade the model's performance on downstream vision tasks. While existing works make remarkable progress on day-night domain adaptation, they rely he…
Action RecognitionDomain AdaptationSemantic SegmentationTemporal Action Localization+1SAM-DA: UAV Tracks Anything at Night with SAM-Powered Domain Adaptation
Domain adaptation (DA) has demonstrated significant promise for real-time nighttime unmanned aerial vehicle (UAV) tracking. However, the state-of-the-art (SOTA) DA still lacks the potential object with accurate pixel-lev…
Domain AdaptationTransfer LearningZero-shot GeneralizationBoosting Object Detection with Zero-Shot Day-Night Domain Adaptation
Detecting objects in low-light scenarios presents a persistent challenge, as detectors trained on well-lit data exhibit significant performance degradation on low-light data due to low visibility. Previous methods mitiga…
Domain AdaptationImage Enhancementobject-detectionObject Detection+1MVAdapt: Zero-Shot Multi-Vehicle Adaptation for End-to-End Autonomous Driving
End-to-End (E2E) autonomous driving models are usually trained and evaluated with a fixed ego-vehicle, even though their driving policy is implicitly tied to vehicle dynamics. When such a model is deployed on a vehicle w…
Autonomous DrivingABRA: Teleporting Fine-Tuned Knowledge Across Domains for Open-Vocabulary Object Detection
Although recent Open-Vocabulary Object Detection architectures, such as Grounding DINO, demonstrate strong zero-shot capabilities, their performance degrades significantly under domain shifts. Moreover, many domains of p…
Object Detection