paper-with-me

Papers

Transfer Learning in Deep Learning Models for Building Load Forecasting: Case of Limited Data

2023-01-25 · Menna Nawar, Moustafa Shomer, Samy Faddel, Huangjie Gong

Precise load forecasting in buildings could increase the bill savings potential and facilitate optimized strategies for power generation planning. With the rapid evolution of computer science, data-driven techniques, in particular the Deep Learning models, have become a promising solution for the load forecasting problem. These models have showed accurate forecasting results; however, they need abundance amount of historical data to maintain the performance. Considering the new buildings and buildings with low resolution measuring equipment, it is difficult to get enough historical data from them, leading to poor forecasting performance. In order to adapt Deep Learning models for buildings with limited and scarce data, this paper proposes a Building-to-Building Transfer Learning framework to overcome the problem and enhance the performance of Deep Learning models. The transfer learning approach was applied to a new technique known as Transformer model due to its efficacy in capturing data trends. The performance of the algorithm was tested on a large commercial building with limited data. The result showed that the proposed approach improved the forecasting accuracy by 56.8% compared to the case of conventional deep learning where training from scratch is used. The paper also compared the proposed Transformer model to other sequential deep learning models such as Long-short Term Memory (LSTM) and Recurrent Neural Network (RNN). The accuracy of the transformer model outperformed other models by reducing the root mean square error to 0.009, compared to LSTM with 0.011 and RNN with 0.051.

📄 PDF Abstract BibTeX arXiv:2301.10663

Code (2)

shomerthesec/Research_timeseries_forecasting_using_ashrae_dataset 공식 구현 tf
shomerthesec/Research-Buildings-Energy-forecasting-using-Deep-Learning tf

Tasks

Deep LearningLoad ForecastingTransfer Learning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
RMSProp RMSProp is an unpublished adaptive learning rate optimizer proposed by Geoff Hinton. The motivation…
SGD Stochastic Gradient Descent is an iterative optimization technique that uses minibatches of data to form an expectation of the gradient, rather than the full gradient using…
b2b transfer learning using transfer learning to transfer knowledge from one building to predict the energy consumption of another building with scarce data
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Location based Probabilistic Load Forecasting of EV Charging Sites: Deep Transfer Learning with Multi-Quantile Temporal Convolutional Network

2024-09-18 · Mohammad Wazed Ali, Asif bin Mustafa, Md. Aukerul Moin Shuvo, Bernhard Sick

Electrification of vehicles is a potential way of reducing fossil fuel usage and thus lessening environmental pollution. Electric Vehicles (EVs) of various types for different transport modes (including air, water, and l…

Load ForecastingTransfer Learning

Energy Predictive Models with Limited Data using Transfer Learning

2019-06-06 · Ali Hooshmand, Ratnesh Sharma

In this paper, we consider the problem of developing predictive models with limited data for energy assets such as electricity loads, PV power generations, etc. We specifically investigate the cases where the amount of h…

Demand ForecastingTime SeriesTime Series AnalysisTransfer Learning

RESCAST-100K: A Comprehensive Dataset for Cross-Domain Residential Load and Indoor Temperature Forecasting

2026-06-01 · Jainam Dhruva, Yousaf Raza, A. B. Siddique, Simone Silvestri arxiv

Accurate short-term forecasting of residential energy load and indoor temperature is essential for home energy management systems, grid-level demand response, and community energy efficiency efforts. Domain adaptation an…

Zero-shot GeneralizationDomain GeneralizationTransfer LearningDomain Adaptation

Using Mobility for Electrical Load Forecasting During the COVID-19 Pandemic

2020-06-15 · Yize Chen, Weiwei Yang, Baosen Zhang

The novel coronavirus (COVID-19) pandemic has posed unprecedented challenges for the utilities and grid operators around the world. In this work, we focus on the problem of load forecasting. With strict social distancing…

Load ForecastingTransfer Learning

Improve Load Forecasting in Energy Communities through Transfer Learning using Open-Access Synthetic Profiles

2024-07-11 · Lukas Moosbrugger, Valentin Seiler, Gerhard Huber, Peter Kepplinger

According to a conservative estimate, a 1% reduction in forecast error for a 10 GW energy utility can save up to $ 1.6 million annually. In our context, achieving precise forecasts of future power consumption is crucial …

Load ForecastingModel Predictive ControlPredictionTransfer Learning