SETrLUSI: Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant
In transfer learning, a source domain often carries diverse knowledge, and different domains usually emphasize different types of knowledge. Different from handling only a single type of knowledge from all domains in traditional transfer learning methods, we introduce an ensemble learning framework with a weak mode of convergence in the form of Statistical Invariant (SI) for multi-source transfer learning, formulated as Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant (SETrLUSI). The proposed SI extracts and integrates various types of knowledge from both source and target domains, which not only effectively utilizes diverse knowledge but also accelerates the convergence process. Further, SETrLUSI incorporates stochastic SI selection, proportional source domain sampling, and target domain bootstrapping, which improves training efficiency while enhancing model stability. Experiments show that SETrLUSI has good convergence and outperforms related methods with a lower time cost.
Code (0)
등록된 구현이 없습니다.
Tasks
Ensemble LearningTransfer LearningSimilar Papers 제목 키워드 기반
Stochastic Variance Reduced Ensemble Adversarial Attack for Boosting the Adversarial Transferability
The black-box adversarial attack has attracted impressive attention for its practical use in the field of deep learning security. Meanwhile, it is very challenging as there is no access to the network architecture or int…
Adversarial AttackStochastic Variance Reduced Ensemble Adversarial Attack
Black-box adversarial attack has attracted much attention for its practical use in deep learning applications, and it is very challenging as there is no access to the architecture and weights of the target model. Based o…
Adversarial AttackH-ensemble: An Information Theoretic Approach to Reliable Few-Shot Multi-Source-Free Transfer
Multi-source transfer learning is an effective solution to data scarcity by utilizing multiple source tasks for the learning of the target task. However, access to source data and model details is limited in the era of c…
Transfer LearningDynamic Stochastic Ensemble with Adversarial Robust Lottery Ticket Subnetworks
Adversarial attacks are considered the intrinsic vulnerability of CNNs. Defense strategies designed for attacks have been stuck in the adversarial attack-defense arms race, reflecting the imbalance between attack and def…
Adversarial AttackDiversityMulti-source Transfer Learning with Ensemble for Financial Time Series Forecasting
Although transfer learning is proven to be effective in computer vision and natural language processing applications, it is rarely investigated in forecasting financial time series. Majority of existing works on transfer…
Time SeriesTime Series AnalysisTime Series ForecastingTransfer Learning