paper-with-me

Papers

Leveraging Hypernetworks and Learnable Kernels for Consumer Energy Forecasting Across Diverse Consumer Types

2025-02-07 · Muhammad Umair Danish, Katarina Grolinger

Consumer energy forecasting is essential for managing energy consumption and planning, directly influencing operational efficiency, cost reduction, personalized energy management, and sustainability efforts. In recent years, deep learning techniques, especially LSTMs and transformers, have been greatly successful in the field of energy consumption forecasting. Nevertheless, these techniques have difficulties in capturing complex and sudden variations, and, moreover, they are commonly examined only on a specific type of consumer (e.g., only offices, only schools). Consequently, this paper proposes HyperEnergy, a consumer energy forecasting strategy that leverages hypernetworks for improved modeling of complex patterns applicable across a diversity of consumers. Hypernetwork is responsible for predicting the parameters of the primary prediction network, in our case LSTM. A learnable adaptable kernel, comprised of polynomial and radial basis function kernels, is incorporated to enhance performance. The proposed HyperEnergy was evaluated on diverse consumers including, student residences, detached homes, a home with electric vehicle charging, and a townhouse. Across all consumer types, HyperEnergy consistently outperformed 10 other techniques, including state-of-the-art models such as LSTM, AttentionLSTM, and transformer.

📄 PDF Abstract BibTeX arXiv:2502.05104

Code (0)

등록된 구현이 없습니다.

Tasks

Diversityenergy management

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
HyperNetwork A HyperNetwork is a network that generates weights for a main network. The behavior of the main network is the same with any usual neural network: it learns to map some raw…

Similar Papers 제목 키워드 기반

Enhancing Diversity in Bayesian Deep Learning via Hyperspherical Energy Minimization of CKA

2024-10-31 · David Smerkous, Qinxun Bai, Fuxin Li

Particle-based Bayesian deep learning often requires a similarity metric to compare two networks. However, naive similarity metrics lack permutation invariance and are inappropriate for comparing networks. Centered Kerne…

Deep LearningDiversityOutlier DetectionUncertainty Quantification

HyperNetworks

2016-09-27 · David Ha, Andrew Dai, Quoc V. Le

This work explores hypernetworks: an approach of using a one network, also known as a hypernetwork, to generate the weights for another network. Hypernetworks provide an abstraction that is similar to what is found in na…

Handwriting generationLanguage ModellingMachine TranslationTranslation

On Infinite-Width Hypernetworks

2020-03-27 · NeurIPS 2020 12 · Etai Littwin, Tomer Galanti, Lior Wolf, Greg Yang

{\em Hypernetworks} are architectures that produce the weights of a task-specific {\em primary network}. A notable application of hypernetworks in the recent literature involves learning to output functional representati…

Meta-Learning

Leveraging External Factors in Household-Level Electrical Consumption Forecasting using Hypernetworks

2025-06-17 · Fabien Bernier, Maxime Cordy, Yves Le Traon

Accurate electrical consumption forecasting is crucial for efficient energy management and resource allocation. While traditional time series forecasting relies on historical patterns and temporal dependencies, incorpora…

energy managementTime Series Forecasting

An Insurance Paradigm for Improving Power System Resilience via Distributed Investment

2023-02-02 · Farhad Billimoria, Filiberto Fele, Iacopo Savelli, Thomas Morstyn 외

Extreme events, exacerbated by climate change, pose significant risks to the energy system and its consumers. However there are natural limits to the degree of protection that can be delivered from a centralised market a…