FiniteNet: A Fully Convolutional LSTM Network Architecture for Time-Dependent Partial Differential Equations

2020-02-07 · Ben Stevens, Tim Colonius

In this work, we present a machine learning approach for reducing the error when numerically solving time-dependent partial differential equations (PDE). We use a fully convolutional LSTM network to exploit the spatiotemporal dynamics of PDEs. The neural network serves to enhance finite-difference and finite-volume methods (FDM/FVM) that are commonly used to solve PDEs, allowing us to maintain guarantees on the order of convergence of our method. We train the network on simulation data, and show that our network can reduce error by a factor of 2 to 3 compared to the baseline algorithms. We demonstrate our method on three PDEs that each feature qualitatively different dynamics. We look at the linear advection equation, which propagates its initial conditions at a constant speed, the inviscid Burgers' equation, which develops shockwaves, and the Kuramoto-Sivashinsky (KS) equation, which is chaotic.

📄 PDF Abstract BibTeX arXiv:2002.03014

Code (1)

FiniteNetICML2020Code/FiniteNet 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Deep Gated Recurrent and Convolutional Network Hybrid Model for Univariate Time Series Classification

2018-12-18 · Nelly Elsayed, Anthony S. Maida, Magdy Bayoumi

Hybrid LSTM-fully convolutional networks (LSTM-FCN) for time series classification have produced state-of-the-art classification results on univariate time series. We show that replacing the LSTM with a gated recurrent u…

Classification General Classification Time Series Time Series Analysis+1

Improving Time Series Classification Algorithms Using Octave-Convolutional Layers

2021-09-28 · Samuel Harford, Fazle Karim, Houshang Darabi

Deep learning models utilizing convolution layers have achieved state-of-the-art performance on univariate time series classification tasks. In this work, we propose improving CNN based time series classifiers by utilizi…

Classification Time Series Time Series Analysis Time Series Classification

LSTM Fully Convolutional Networks for Time Series Classification

2017-09-08 · Fazle Karim, Somshubra Majumdar, Houshang Darabi, Shun Chen

Fully convolutional neural networks (FCN) have been shown to achieve state-of-the-art performance on the task of classifying time series sequences. We propose the augmentation of fully convolutional networks with long sh…

General Classification Outlier Detection Time Series Time Series Analysis+1

Recurrence-free unconstrained handwritten text recognition using gated fully convolutional network

2020-12-09 · Denis Coquenet, Clément Chatelain, Thierry Paquet

Unconstrained handwritten text recognition is a major step in most document analysis tasks. This is generally processed by deep recurrent neural networks and more specifically with the use of Long Short-Term Memory cells…

Handwritten Text Recognition

Performance of Three Slim Variants of The Long Short-Term Memory (LSTM) Layer

2019-01-02 · Daniel Kent, Fathi M. Salem

The Long Short-Term Memory (LSTM) layer is an important advancement in the field of neural networks and machine learning, allowing for effective training and impressive inference performance. LSTM-based neural networks h…

Translation