paper-with-me

Papers

Piecewise-constant Neural ODEs

2021-06-11 · Sam Greydanus, Stefan Lee, Alan Fern

Neural networks are a popular tool for modeling sequential data but they generally do not treat time as a continuous variable. Neural ODEs represent an important exception: they parameterize the time derivative of a hidden state with a neural network and then integrate over arbitrary amounts of time. But these parameterizations, which have arbitrary curvature, can be hard to integrate and thus train and evaluate. In this paper, we propose making a piecewise-constant approximation to Neural ODEs to mitigate these issues. Our model can be integrated exactly via Euler integration and can generate autoregressive samples in 3-20 times fewer steps than comparable RNN and ODE-RNN models. We evaluate our model on several synthetic physics tasks and a planning task inspired by the game of billiards. We find that it matches the performance of baseline approaches while requiring less time to train and evaluate.

📄 PDF Abstract BibTeX arXiv:2106.06621

Code (1)

greydanus/piecewise_node 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Neural Piecewise-Constant Delay Differential Equations

2022-01-04 · Qunxi Zhu, Yifei Shen, Dongsheng Li, Wei Lin

Continuous-depth neural networks, such as the Neural Ordinary Differential Equations (ODEs), have aroused a great deal of interest from the communities of machine learning and data science in recent years, which bridge t…

Testing Piecewise Functions

2017-06-23 · Steve Hanneke, Liu Yang

This work explores the query complexity of property testing for general piecewise functions on the real line, in the active and passive property testing settings. The results are proven under an abstract zero-measure cro…

ReLU neural network approximation to piecewise constant functions

2024-10-21 · Zhiqiang Cai, Junpyo Choi, Min Liu

This paper studies the approximation property of ReLU neural networks (NNs) to piecewise constant functions with unknown interfaces in bounded regions in $\mathbb{R}^d$. Under the assumption that the discontinuity interf…

Regularized Estimation of Piecewise Constant Gaussian Graphical Models: The Group-Fused Graphical Lasso

2015-12-19 · Alexander J. Gibberd, James D. B. Nelson

The time-evolving precision matrix of a piecewise-constant Gaussian graphical model encodes the dynamic conditional dependency structure of a multivariate time-series. Traditionally, graphical models are estimated under …

Time SeriesTime Series Analysis

Image segmentation by optimal and hierarchical piecewise constant approximations

2013-06-10 · M. Kharinov

Piecewise constant image approximations of sequential number of segments or clusters of disconnected pixels are treated. The method of majorizing of optimal approximation sequence by hierarchical sequence of image approx…

Image SegmentationSemantic Segmentation