Leveraging Hypernetworks and Learnable Kernels for Consumer Energy Forecasting Across Diverse Consumer Types
Consumer energy forecasting is essential for managing energy consumption and planning, directly influencing operational efficiency, cost reduction, personalized energy management, and sustainability efforts. In recent years, deep learning techniques, especially LSTMs and transformers, have been greatly successful in the field of energy consumption forecasting. Nevertheless, these techniques have difficulties in capturing complex and sudden variations, and, moreover, they are commonly examined only on a specific type of consumer (e.g., only offices, only schools). Consequently, this paper proposes HyperEnergy, a consumer energy forecasting strategy that leverages hypernetworks for improved modeling of complex patterns applicable across a diversity of consumers. Hypernetwork is responsible for predicting the parameters of the primary prediction network, in our case LSTM. A learnable adaptable kernel, comprised of polynomial and radial basis function kernels, is incorporated to enhance performance. The proposed HyperEnergy was evaluated on diverse consumers including, student residences, detached homes, a home with electric vehicle charging, and a townhouse. Across all consumer types, HyperEnergy consistently outperformed 10 other techniques, including state-of-the-art models such as LSTM, AttentionLSTM, and transformer.
Code (0)
등록된 구현이 없습니다.
Tasks
Diversityenergy managementMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enhancing Diversity in Bayesian Deep Learning via Hyperspherical Energy Minimization of CKA
Particle-based Bayesian deep learning often requires a similarity metric to compare two networks. However, naive similarity metrics lack permutation invariance and are inappropriate for comparing networks. Centered Kerne…
Deep LearningDiversityOutlier DetectionUncertainty QuantificationHyperNetworks
This work explores hypernetworks: an approach of using a one network, also known as a hypernetwork, to generate the weights for another network. Hypernetworks provide an abstraction that is similar to what is found in na…
Handwriting generationLanguage ModellingMachine TranslationTranslationOn Infinite-Width Hypernetworks
{\em Hypernetworks} are architectures that produce the weights of a task-specific {\em primary network}. A notable application of hypernetworks in the recent literature involves learning to output functional representati…
Meta-LearningLeveraging External Factors in Household-Level Electrical Consumption Forecasting using Hypernetworks
Accurate electrical consumption forecasting is crucial for efficient energy management and resource allocation. While traditional time series forecasting relies on historical patterns and temporal dependencies, incorpora…
energy managementTime Series ForecastingAn Insurance Paradigm for Improving Power System Resilience via Distributed Investment
Extreme events, exacerbated by climate change, pose significant risks to the energy system and its consumers. However there are natural limits to the degree of protection that can be delivered from a centralised market a…