paper-with-me

홈 › Papers

Domain transfer through deep activation matching

2018-09-01 · ECCV 2018 9 · Haoshuo Huang, Qi-Xing Huang, Philipp Krahenbuhl

We introduce a layer-wise unsupervised domain adaptation approach for the task of semantic segmentation. Instead of merely matching the output distributions of the source and target domains, our approach aligns the distributions of activations of intermediate layers. This scheme exhibits two key advantages. First, matching across intermediate layers introduces more constraints for training the network in the target domain, making the optimization problem better conditioned. Second, the matched activations at each layer provide similar inputs to the next layer for both training and adaptation, and thus alleviate covariate shift. We use a Generative Adversarial Network (or GAN) to align activation distributions. Experimental results show that our approach achieves state-of-the-art results on a variety of popular domain adaptation tasks, including (1) from GTA to Cityscapes for semantic segmentation, (2) from SYNTHIA to Cityscapes for semantic segmentation, and (3) adaptations on USPS and MNIST for image classification.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationGenerative Adversarial Networkimage-classificationImage ClassificationSegmentationSemantic SegmentationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Knowledge Transfer with Jacobian Matching

2018-03-01 · ICML 2018 7 · Suraj Srinivas, Francois Fleuret

Classical distillation methods transfer representations from a "teacher" neural network to a "student" network by matching their output activations. Recent methods also match the Jacobians, or the gradient of output acti…

Transfer Learning

Enhancing Cross-task Transfer of Large Language Models via Activation Steering

2025-07-17 · Xinyu Tang, Zhihao Lv, Xiaoxue Cheng, Junyi Li 외

Large language models (LLMs) have shown impressive abilities in leveraging pretrained knowledge through prompting, but they often struggle with unseen tasks, particularly in data-scarce scenarios. While cross-task in-con…

Cross-Lingual TransferIn-Context Learning

KD$^{2}$M: An unifying framework for feature knowledge distillation

2025-04-02 · Eduardo Fernandes Montesuma

Knowledge Distillation (KD) seeks to transfer the knowledge of a teacher, towards a student neural net. This process is often done by matching the networks' predictions (i.e., their output), but, recently several works h…

Knowledge Distillation

Transfer Learning Through Conditional Quantile Matching

2026-02-02 · Yikun Zhang, Steven Wilkins-Reeves, Wesley Lee, Aude Hofleitner arxiv

We introduce a transfer learning framework for regression that leverages heterogeneous source domains to improve predictive performance in a data-scarce target domain. Our approach learns a conditional generative model s…

Transfer LearningData Augmentation

DWMD: Dimensional Weighted Orderwise Moment Discrepancy for Domain-specific Hidden Representation Matching

2020-07-18 · Rongzhe Wei, Fa Zhang, Bo Dong, Qinghua Zheng

Knowledge transfer from a source domain to a different but semantically related target domain has long been an important topic in the context of unsupervised domain adaptation (UDA). A key challenge in this field is esta…

Domain AdaptationTransfer LearningUnsupervised Domain Adaptationvalid