paper-with-me

홈 › Papers

EF-LLM: Energy Forecasting LLM with AI-assisted Automation, Enhanced Sparse Prediction, Hallucination Detection

2024-10-30 · Zihang Qiu, Chaojie Li, Zhongyang Wang, Renyou Xie, Borui Zhang, Huadong Mo, Guo Chen, ZhaoYang Dong

Accurate prediction helps to achieve supply-demand balance in energy systems, supporting decision-making and scheduling. Traditional models, lacking AI-assisted automation, rely on experts, incur high costs, and struggle with sparse data prediction. To address these challenges, we propose the Energy Forecasting Large Language Model (EF-LLM), which integrates domain knowledge and temporal data for time-series forecasting, supporting both pre-forecast operations and post-forecast decision-support. EF-LLM's human-AI interaction capabilities lower the entry barrier in forecasting tasks, reducing the need for extra expert involvement. To achieve this, we propose a continual learning approach with updatable LoRA and a multi-channel architecture for aligning heterogeneous multimodal data, enabling EF-LLM to continually learn heterogeneous multimodal knowledge. In addition, EF-LLM enables accurate predictions under sparse data conditions through its ability to process multimodal data. We propose Fusion Parameter-Efficient Fine-Tuning (F-PEFT) method to effectively leverage both time-series data and text for this purpose. EF-LLM is also the first energy-specific LLM to detect hallucinations and quantify their occurrence rate, achieved via multi-task learning, semantic similarity analysis, and ANOVA. We have achieved success in energy prediction scenarios for load, photovoltaic, and wind power forecast.

📄 PDF Abstract BibTeX arXiv:2411.00852

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningHallucinationLarge Language ModelMulti-Task Learningparameter-efficient fine-tuningSchedulingSemantic SimilaritySemantic Textual SimilarityTime SeriesTime Series Forecasting

Similar Papers 제목 키워드 기반

DeepTSF: Codeless machine learning operations for time series forecasting

2023-07-28 · Sotiris Pelekis, Evangelos Karakolis, Theodosios Pountridis, George Kormpakis 외

This paper presents DeepTSF, a comprehensive machine learning operations (MLOps) framework aiming to innovate time series forecasting through workflow automation and codeless modeling. DeepTSF automates key aspects of th…

Load ForecastingManagementTime SeriesTime Series Forecasting

Review of automated time series forecasting pipelines

2022-02-03 · Stefan Meisenbacher, Marian Turowski, Kaleb Phipps, Martin Rätz 외

Time series forecasting is fundamental for various use cases in different domains such as energy systems and economics. Creating a forecasting model for a specific use case requires an iterative and complex design proces…

AutoMLFeature EngineeringHyperparameter OptimizationTime Series+2

Financial Time Series Analysis and Forecasting with HHT Feature Generation and Machine Learning

2021-05-23 · Tim Leung, Theodore Zhao

We present the method of complementary ensemble empirical mode decomposition (CEEMD) and Hilbert-Huang transform (HHT) for analyzing nonstationary financial time series. This noise-assisted approach decomposes any time s…

BIG-bench Machine LearningTime SeriesTime Series Analysis

RTL++: Graph-enhanced LLM for RTL Code Generation

2025-05-11 · Mohammad Akyash, Kimia Azar, Hadi Kamali

As hardware design complexity escalates, there is an urgent need for advanced automation in electronic design automation (EDA). Traditional register transfer level (RTL) design methods are manual, time-consuming, and pro…

Code Generation

Integrating the Expected Future in Load Forecasts with Contextually Enhanced Transformer Models

2024-08-26 · Raffael Theiler, Leandro Von Krannichfeldt, Giovanni Sansavini, Michael F. Howland 외

Accurate and reliable energy forecasting is essential for power grid operators who strive to minimize extreme forecasting errors that pose significant operational challenges and incur high intra-day trading costs. Incorp…

regressionSpecificity