Source-Free Video Domain Adaptation With Spatial-Temporal-Historical Consistency Learning
Source-free domain adaptation (SFDA) is an emerging research topic that studies how to adapt a pretrained source model using unlabeled target data. It is derived from unsupervised domain adaptation but has the advantage of not requiring labeled source data to learn adaptive models. This makes it particularly useful in real-world applications where access to source data is restricted. While there has been some SFDA work for images, little attention has been paid to videos. Naively extending image-based methods to videos without considering the unique properties of videos often leads to unsatisfactory results. In this paper, we propose a simple and highly flexible method for Source-Free Video Domain Adaptation (SFVDA), which extensively exploits consistency learning for videos from spatial, temporal, and historical perspectives. Our method is based on the assumption that videos of the same action category are drawn from the same low-dimensional space, regardless of the spatio-temporal variations in the high-dimensional space that cause domain shifts. To overcome domain shifts, we simulate spatio-temporal variations by applying spatial and temporal augmentations on target videos, and encourage the model to make consistent predictions from a video and its augmented versions. Due to the simple design, our method can be applied to various SFVDA settings, and experiments show that our method achieves state-of-the-art performance for all the settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSource-Free Domain AdaptationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
CycDA: Unsupervised Cycle Domain Adaptation from Image to Video
Although action recognition has achieved impressive results over recent years, both collection and annotation of video training data are still time-consuming and cost intensive. Therefore, image-to-video adaptation has b…
Action RecognitionDomain AdaptationTransfer LearningSource-free Domain Adaptation for Video Object Detection Under Adverse Image Conditions
When deploying pre-trained video object detectors in real-world scenarios, the domain gap between training and testing data caused by adverse image conditions often leads to performance degradation. Addressing this issue…
Domain AdaptationObjectobject-detectionObject Detection+3Source-free Video Domain Adaptation by Learning Temporal Consistency for Action Recognition
Video-based Unsupervised Domain Adaptation (VUDA) methods improve the robustness of video models, enabling them to be applied to action recognition tasks across different environments. However, these methods require cons…
Action RecognitionDomain AdaptationSource-Free Domain AdaptationUnsupervised Domain AdaptationOvercoming Label Noise for Source-free Unsupervised Video Domain Adaptation
Despite the progress seen in classification methods, current approaches for handling videos with distribution shifts in source and target domains remain source-dependent as they require access to the source data during t…
Domain AdaptationSpatio-Temporal Pixel-Level Contrastive Learning-based Source-Free Domain Adaptation for Video Semantic Segmentation
Unsupervised Domain Adaptation (UDA) of semantic segmentation transfers labeled source knowledge to an unlabeled target domain by relying on accessing both the source and target data. However, the access to source data i…
Contrastive LearningDomain AdaptationSemantic SegmentationSource-Free Domain Adaptation+2