paper-with-me

Papers

Kernel Corrector LSTM

2024-04-28 · Rodrigo Tuna, Yassine Baghoussi, Carlos Soares, João Mendes-Moreira

Forecasting methods are affected by data quality issues in two ways: 1. they are hard to predict, and 2. they may affect the model negatively when it is updated with new data. The latter issue is usually addressed by pre-processing the data to remove those issues. An alternative approach has recently been proposed, Corrector LSTM (cLSTM), which is a Read \& Write Machine Learning (RW-ML) algorithm that changes the data while learning to improve its predictions. Despite promising results being reported, cLSTM is computationally expensive, as it uses a meta-learner to monitor the hidden states of the LSTM. We propose a new RW-ML algorithm, Kernel Corrector LSTM (KcLSTM), that replaces the meta-learner of cLSTM with a simpler method: Kernel Smoothing. We empirically evaluate the forecasting accuracy and the training time of the new algorithm and compare it with cLSTM and LSTM. Results indicate that it is able to decrease the training time while maintaining a competitive forecasting accuracy.

📄 PDF Abstract BibTeX arXiv:2404.18273

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Discrete Predictor-Corrector Diffusion Models for Image Synthesis

2022-09-29 · ICLR Anonymous Submission 2022 9 · Anonymous

We introduce Discrete Predictor-Corrector diffusion models (DPC), extending predictor-corrector samplers in Gaussian diffusion models to the discrete case. Predictor-corrector samplers are a class of samplers for diffusi…

Conditional Image GenerationImage Generation

Meta-Learned Basis Adaptation for Parametric Linear PDEs

2026-04-10 · Vikas Dwivedi, Monica Sigovan, Bruno Sixou arxiv

We propose a hybrid physics-informed framework for solving families of parametric linear partial differential equations (PDEs) by combining a meta-learned predictor with a least-squares corrector. The predictor, termed \…

Multi-components System for Automatic Arabic Diacritization

2020-04-08 · Hamza Abbad, Shengwu Xiong

In this paper, we propose an approach to tackle the problem of the automatic restoration of Arabic diacritics that includes three components stacked in a pipeline: a deep learning model which is a multi-layer recurrent n…

Arabic Text Diacritization

Deep Learning with Kernel Flow Regularization for Time Series Forecasting

2021-09-23 · Mahdy Shirdel, Reza Asadi, Duc Do, Micheal Hintlian

Long Short-Term Memory (LSTM) neural networks have been widely used for time series forecasting problems. However, LSTMs are prone to overfitting and performance reduction during test phases. Several different regulariza…

Deep LearningTime SeriesTime Series AnalysisTime Series Forecasting

WNSpell: a WordNet-Based Spell Corrector

2016-01-01 · GWC 2016 1 · Bill Huang

This paper presents a standalone spell corrector, WNSpell, based on and written for WordNet. It is aimed at generating the best possible suggestion for a mistyped query but can also serve as an all-purpose spell correcto…