Exploring selective image matching methods for zero-shot and few-sample unsupervised domain adaptation of urban canopy prediction
We explore simple methods for adapting a trained multi-task UNet which predicts canopy cover and height to a new geographic setting using remotely sensed data without the need of training a domain-adaptive classifier and extensive fine-tuning. Extending previous research, we followed a selective alignment process to identify similar images in the two geographical domains and then tested an array of data-based unsupervised domain adaptation approaches in a zero-shot setting as well as with a small amount of fine-tuning. We find that the selective aligned data-based image matching methods produce promising results in a zero-shot setting, and even more so with a small amount of fine-tuning. These methods outperform both an untransformed baseline and a popular data-based image-to-image translation model. The best performing methods were pixel distribution adaptation and fourier domain adaptation on the canopy cover and height tasks respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationImage-to-Image TranslationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimation
Zero-shot 6D object pose estimation involves the detection of novel objects with their 6D poses in cluttered scenes, presenting significant challenges for model generalizability. Fortunately, the recent Segment Anything …
6D Pose Estimation using RGBInstance SegmentationObjectPose Estimation+3AgentGrounder: Zero-Shot 3D Visual Pointcloud Grounding using Multimodal Language Models
3D Visual Grounding (3DVG) is an essential capability for embodied AI, requiring agents to localize objects in 3D scenes based on natural language descriptions. Recent zero-shot methods leverage 2D vision-language models…
Visual GroundingPoint CloudsRGM: A Robust Generalizable Matching Model
Finding corresponding pixels within a pair of images is a fundamental computer vision task with various applications. Due to the specific requirements of different tasks like optical flow estimation and local feature mat…
modelOptical Flow EstimationInstance-aware Image and Sentence Matching with Selective Multimodal LSTM
Effective image and sentence matching depends on how to well measure their global visual-semantic similarity. Based on the observation that such a global similarity arises from a complex aggregation of multiple local sim…
Semantic SimilaritySemantic Textual SimilaritySentenceScale Contrastive Learning with Selective Attentions for Blind Image Quality Assessment
Blind image quality assessment (BIQA) serves as a fundamental task in computer vision, yet it often fails to consistently align with human subjective perception. Recent advances show that multi-scale evaluation strategie…
Blind Image Quality AssessmentContrastive LearningImage Quality Assessment