CycDA: Unsupervised Cycle Domain Adaptation from Image to Video
Although action recognition has achieved impressive results over recent years, both collection and annotation of video training data are still time-consuming and cost intensive. Therefore, image-to-video adaptation has been proposed to exploit labeling-free web image source for adapting on unlabeled target videos. This poses two major challenges: (1) spatial domain shift between web images and video frames; (2) modality gap between image and video data. To address these challenges, we propose Cycle Domain Adaptation (CycDA), a cycle-based approach for unsupervised image-to-video domain adaptation by leveraging the joint spatial information in images and videos on the one hand and, on the other hand, training an independent spatio-temporal model to bridge the modality gap. We alternate between the spatial and spatio-temporal learning with knowledge transfer between the two in each cycle. We evaluate our approach on benchmark datasets for image-to-video as well as for mixed-source domain adaptation achieving state-of-the-art results and demonstrating the benefits of our cyclic adaptation. Code is available at \url{https://github.com/wlin-at/CycDA}.
Code (1)
Tasks
Action RecognitionDomain AdaptationTransfer LearningSimilar Papers 제목 키워드 기반
Structure Preserving Cycle-GAN for Unsupervised Medical Image Domain Adaptation
The presence of domain shift in medical imaging is a common issue, which can greatly impact the performance of segmentation models when dealing with unseen image domains. Adversarial-based deep learning models, such as C…
Domain AdaptationMyocardium SegmentationSegmentationUnsupervised Domain AdaptationFine-Tuning Cycle-GAN for Domain Adaptation of MRI Images
Magnetic Resonance Imaging (MRI) scans acquired from different scanners or institutions often suffer from domain shifts owing to variations in hardware, protocols, and acquisition parameters. This discrepancy degrades th…
Domain AdaptationUnsupervised Domain Adaptation via CycleGAN for White Matter Hyperintensity Segmentation in Multicenter MR Images
Automatic segmentation of white matter hyperintensities in magnetic resonance images is of paramount clinical and research importance. Quantification of these lesions serve as a predictor for risk of stroke, dementia and…
Domain AdaptationImage SegmentationSegmentationSemantic Segmentation+1Edge-preserving Domain Adaptation for semantic segmentation of Medical Images
Domain Adaptation is a technique to address the lack of massive amounts of labeled data in unseen environments. Unsupervised domain adaptation is proposed to adapt a model to new modalities using solely labeled source da…
Domain AdaptationSegmentationSemantic SegmentationUnsupervised Domain AdaptationUnsupervised Domain Adaptation for Mammogram Image Classification: A Promising Tool for Model Generalization
Generalization is one of the key challenges in the clinical validation and application of deep learning models to medical images. Studies have shown that such models trained on publicly available datasets often do not wo…
Domain AdaptationGeneral Classificationimage-classificationImage Classification+1