paper-with-me

홈 › Papers

SNN: Stacked Neural Networks

2016-05-27 · Milad Mohammadi, Subhasis Das

It has been proven that transfer learning provides an easy way to achieve state-of-the-art accuracies on several vision tasks by training a simple classifier on top of features obtained from pre-trained neural networks. The goal of this work is to generate better features for transfer learning from multiple publicly available pre-trained neural networks. To this end, we propose a novel architecture called Stacked Neural Networks which leverages the fast training time of transfer learning while simultaneously being much more accurate. We show that using a stacked NN architecture can result in up to 8% improvements in accuracy over state-of-the-art techniques using only one pre-trained network for transfer learning. A second aim of this work is to make network fine- tuning retain the generalizability of the base network to unseen tasks. To this end, we propose a new technique called "joint fine-tuning" that is able to give accuracies comparable to finetuning the same network individually over two datasets. We also show that a jointly finetuned network generalizes better to unseen tasks when compared to a network finetuned over a single task.

📄 PDF Abstract BibTeX arXiv:1605.08512

Code (0)

등록된 구현이 없습니다.

Tasks

Transfer Learning

Similar Papers 제목 키워드 기반

Multi-Scale Stacked Hourglass Network for Human Pose Estimation

2019-05-01 · ICLR 2019 5 · Chunsheng Guo, Wenlong Du, Na Ying

Stacked hourglass network has become an important model for Human pose estimation. The estimation of human body posture depends on the global information of the keypoints type and the local information of the keypoints l…

Pose Estimation

pystacked: Stacking generalization and machine learning in Stata

2022-08-23 · Achim Ahrens, Christian B. Hansen, Mark E. Schaffer

pystacked implements stacked generalization (Wolpert, 1992) for regression and binary classification via Python's scikit-learn. Stacking combines multiple supervised machine learners -- the "base" or "level-0" learners -…

Binary Classificationregression

Spatio-temporal Stacked LSTM for Temperature Prediction in Weather Forecasting

2018-11-15 · Zahra Karevan, Johan A. K. Suykens

Long Short-Term Memory (LSTM) is a well-known method used widely on sequence learning and time series prediction. In this paper we deployed stacked LSTM model in an application of weather forecasting. We propose a 2-laye…

PredictionTime SeriesTime Series AnalysisTime Series Prediction+1

Environmental Modeling Framework using Stacked Gaussian Processes

2016-12-09 · Kareem Abdelfatah, Junshu Bao, Gabriel Terejanu

A network of independently trained Gaussian processes (StackedGP) is introduced to obtain predictions of quantities of interest with quantified uncertainties. The main applications of the StackedGP framework are to integ…

Gaussian Processes

Approximating Stacked and Bidirectional Recurrent Architectures with the Delayed Recurrent Neural Network

2019-08-30 · ICML 2020 1 · Javier S. Turek, Shailee Jain, Vy Vo, Mihai Capota 외

Recent work has shown that topological enhancements to recurrent neural networks (RNNs) can increase their expressiveness and representational capacity. Two popular enhancements are stacked RNNs, which increases the capa…