Domain Adaptation and Transfer Learning in StochasticNets

2015-12-18 · Mohammad Javad Shafiee, Parthipan Siva, Paul Fieguth, Alexander Wong

Transfer learning is a recent field of machine learning research that aims to resolve the challenge of dealing with insufficient training data in the domain of interest. This is a particular issue with traditional deep neural networks where a large amount of training data is needed. Recently, StochasticNets was proposed to take advantage of sparse connectivity in order to decrease the number of parameters that needs to be learned, which in turn may relax training data size requirements. In this paper, we study the efficacy of transfer learning on StochasticNet frameworks. Experimental results show ~7% improvement on StochasticNet performance when the transfer learning is applied in training step.

📄 PDF Abstract BibTeX arXiv:1512.05844

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning Domain Adaptation Transfer Learning

Efficient Deep Feature Learning and Extraction via StochasticNets

2015-12-11 · Mohammad Javad Shafiee, Parthipan Siva, Paul Fieguth, Alexander Wong

Deep neural networks are a powerful tool for feature learning and extraction given their ability to model high-level abstractions in highly complex data. One area worth exploring in feature learning and extraction using …

Classification General Classification

Learning to Transfer Examples for Partial Domain Adaptation

2019-03-28 · CVPR 2019 6 · Zhangjie Cao, Kaichao You, Mingsheng Long, Jian-Min Wang 외

Domain adaptation is critical for learning in new and unseen environments. With domain adversarial training, deep networks can learn disentangled and transferable features that effectively diminish the dataset shift betw…

Domain Adaptation Partial Domain Adaptation Transfer Learning

Domain Adaptation Meets Disentangled Representation Learning and Style Transfer

2017-12-25 · Hoang Tran Vu, Ching-Chun Huang

Many methods have been proposed to solve the domain adaptation problem recently. However, the success of them implicitly funds on the assumption that the information of domains are fully transferrable. If the assumption …

Domain Adaptation Representation Learning Style Transfer Transfer Learning

A Broad Study of Pre-training for Domain Generalization and Adaptation

2022-03-22 · Donghyun Kim, Kaihong Wang, Stan Sclaroff, Kate Saenko

Deep models must learn robust and transferable representations in order to perform well on new domains. While domain transfer methods (e.g., domain adaptation, domain generalization) have been proposed to learn transfera…

Domain Adaptation Domain Generalization

Partial Adversarial Domain Adaptation

2018-08-10 · ECCV 2018 9 · Zhangjie Cao, Lijia Ma, Mingsheng Long, Jian-Min Wang

Domain adversarial learning aligns the feature distributions across the source and target domains in a two-player minimax game. Existing domain adversarial networks generally assume identical label space across different…

Domain Adaptation Partial Domain Adaptation