Adaptive Explainable Continual Learning Framework for Regression Problems with Focus on Power Forecasts
Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn new tasks and overcome forgetting the knowledge obtained from the old tasks as the amount of data keeps increasing in applications. In this article, two continual learning scenarios will be proposed to describe the potential challenges in this context. Besides, based on our previous work regarding the CLeaR framework, which is short for continual learning for regression tasks, the work will be further developed to enable models to extend themselves and learn data successively. Research topics are related but not limited to developing continual deep learning algorithms, strategies for non-stationarity detection in data streams, explainable and visualizable artificial intelligence, etc. Moreover, the framework- and algorithm-related hyperparameters should be dynamically updated in applications. Forecasting experiments will be conducted based on power generation and consumption data collected from real-world applications. A series of comprehensive evaluation metrics and visualization tools can help analyze the experimental results. The proposed framework is expected to be generally applied to other constantly changing scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningregressionSimilar Papers 제목 키워드 기반
Continual Learning for non-stationary regression via Memory-Efficient Replay
Data streams are rarely static in dynamic environments like Industry 4.0. Instead, they constantly change, making traditional offline models outdated unless they can quickly adjust to the new data. This need can be adequ…
Continual LearningLocally Linear Continual Learning for Time Series based on VC-Theoretical Generalization Bounds
Most machine learning methods assume fixed probability distributions, limiting their applicability in nonstationary real-world scenarios. While continual learning methods address this issue, current approaches often rely…
Time Series ForecastingContinual LearningExplainability and Continual Learning meet Federated Learning at the Network Edge
As edge devices become more capable and pervasive in wireless networks, there is growing interest in leveraging their collective compute power for distributed learning. However, optimizing learning at the network edge en…
Continual LearningEdge-computingExplainable ModelsFederated Learning+2GPTreeO: An R package for continual regression with dividing local Gaussian processes
We introduce GPTreeO, a flexible R package for scalable Gaussian process (GP) regression, particularly tailored to continual learning problems. GPTreeO builds upon the Dividing Local Gaussian Processes (DLGP) algorithm, …
Continual LearningGaussian ProcessesregressionCLeaR: An Adaptive Continual Learning Framework for Regression Tasks
Catastrophic forgetting means that a trained neural network model gradually forgets the previously learned tasks when being retrained on new tasks. Overcoming the forgetting problem is a major problem in machine learning…
Continual LearningIncremental LearningregressionTime Series Analysis