Learning Causal Domain-Invariant Temporal Dynamics for Few-Shot Action Recognition
Few-shot action recognition aims at quickly adapting a pre-trained model to the novel data with a distribution shift using only a limited number of samples. Key challenges include how to identify and leverage the transferable knowledge learned by the pre-trained model. We therefore propose CDTD, or Causal Domain-Invariant Temporal Dynamics for knowledge transfer. To identify the temporally invariant and variant representations, we employ the causal representation learning methods for unsupervised pertaining, and then tune the classifier with supervisions in next stage. Specifically, we assume the domain information can be well estimated and the pre-trained image decoder and transition models can be well transferred. During adaptation, we fix the transferable temporal dynamics and update the image encoder and domain estimator. The efficacy of our approach is revealed by the superior accuracy of CDTD over leading alternatives across standard few-shot action recognition datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionDecoderFew-Shot action recognitionFew Shot Action RecognitionRepresentation LearningTransfer LearningSimilar Papers 제목 키워드 기반
Causal Semantic Alignment for LLM-based Time Series Forecasting
Recent advances in Large Language Models (LLMs) have opened new possibilities for time series forecasting by enabling alignment between temporal patterns and pretrained word embeddings. However, most LLM-based methods ov…
Time Series ForecastingA Generalizable Physics-guided Causal Model for Trajectory Prediction in Autonomous Driving
Trajectory prediction for traffic agents is critical for safe autonomous driving. However, achieving effective zero-shot generalization in previously unseen domains remains a significant challenge. Motivated by the consi…
Zero-shot GeneralizationTrajectory PredictionAutonomous DrivingCURVE: Learning Causality-Inspired Invariant Representations for Robust Scene Understanding via Uncertainty-Guided Regularization
Scene graphs provide structured abstractions for scene understanding, yet they often overfit to spurious correlations, severely hindering out-of-distribution generalization. To address this limitation, we propose CURVE, …
Scene UnderstandingTime Series Domain Adaptation via Latent Invariant Causal Mechanism
Time series domain adaptation aims to transfer the complex temporal dependence from the labeled source domain to the unlabeled target domain. Recent advances leverage the stable causal mechanism over observed variables t…
Domain AdaptationTime SeriesTime Series ClassificationVariational InferenceTemporal Causal Prior-Data Fitted Networks for Panel Data with Learned Reliability Signals
Estimating causal effects in industrial time series requires handling temporal dynamics, time-varying treatments, and unobserved confounders. Existing causal foundation models (CausalPFN, CausalFM) operate only on static…