Aligning Correlation Information for Domain Adaptation in Action Recognition
Domain adaptation (DA) approaches address domain shift and enable networks to be applied to different scenarios. Although various image DA approaches have been proposed in recent years, there is limited research towards video DA. This is partly due to the complexity in adapting the different modalities of features in videos, which includes the correlation features extracted as long-term dependencies of pixels across spatiotemporal dimensions. The correlation features are highly associated with action classes and proven their effectiveness in accurate video feature extraction through the supervised action recognition task. Yet correlation features of the same action would differ across domains due to domain shift. Therefore we propose a novel Adversarial Correlation Adaptation Network (ACAN) to align action videos by aligning pixel correlations. ACAN aims to minimize the distribution of correlation information, termed as Pixel Correlation Discrepancy (PCD). Additionally, video DA research is also limited by the lack of cross-domain video datasets with larger domain shifts. We, therefore, introduce a novel HMDB-ARID dataset with a larger domain shift caused by a larger statistical difference between domains. This dataset is built in an effort to leverage current datasets for dark video classification. Empirical results demonstrate the state-of-the-art performance of our proposed ACAN for both existing and the new video DA datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionDomain AdaptationVideo ClassificationSimilar Papers 제목 키워드 기반
Aligning Non-Causal Factors for Transformer-Based Source-Free Domain Adaptation
Conventional domain adaptation algorithms aim to achieve better generalization by aligning only the task-discriminative causal factors between a source and target domain. However, we find that retaining the spurious corr…
DisentanglementDomain AdaptationPrivacy PreservingSource-Free Domain AdaptationDARE-GRAM : Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matrices
Unsupervised Domain Adaptation Regression (DAR) aims to bridge the domain gap between a labeled source dataset and an unlabelled target dataset for regression problems. Recent works mostly focus on learning a deep featur…
Domain AdaptationregressionUnsupervised Domain AdaptationDARE-GRAM: Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matrices
Unsupervised Domain Adaptation Regression (DAR) aims to bridge the domain gap between a labeled source dataset and an unlabelled target dataset for regression problems. Recent works mostly focus on learning a deep fe…
Domain AdaptationregressionUnsupervised Domain AdaptationReturn of Frustratingly Easy Domain Adaptation
Unlike human learning, machine learning often fails to handle changes between training (source) and test (target) input distributions. Such domain shifts, common in practical scenarios, severely damage the performance of…
BIG-bench Machine LearningDomain AdaptationUnsupervised Domain AdaptationAD-Aligning: Emulating Human-like Generalization for Cognitive Domain Adaptation in Deep Learning
Domain adaptation is pivotal for enabling deep learning models to generalize across diverse domains, a task complicated by variations in presentation and cognitive nuances. In this paper, we introduce AD-Aligning, a nove…
Domain Adaptation