paper-with-me

홈 › Papers

Variational Neural Stochastic Differential Equations with Change Points

2024-11-01 · Yousef El-Laham, Zhongchang Sun, Haibei Zhu, Tucker Balch, Svitlana Vyetrenko

In this work, we explore modeling change points in time-series data using neural stochastic differential equations (neural SDEs). We propose a novel model formulation and training procedure based on the variational autoencoder (VAE) framework for modeling time-series as a neural SDE. Unlike existing algorithms training neural SDEs as VAEs, our proposed algorithm only necessitates a Gaussian prior of the initial state of the latent stochastic process, rather than a Wiener process prior on the entire latent stochastic process. We develop two methodologies for modeling and estimating change points in time-series data with distribution shifts. Our iterative algorithm alternates between updating neural SDE parameters and updating the change points based on either a maximum likelihood-based approach or a change point detection algorithm using the sequential likelihood ratio test. We provide a theoretical analysis of this proposed change point detection scheme. Finally, we present an empirical evaluation that demonstrates the expressive power of our proposed model, showing that it can effectively model both classical parametric SDEs and some real datasets with distribution shifts.

📄 PDF Abstract BibTeX arXiv:2411.00635

Code (0)

등록된 구현이 없습니다.

Tasks

Change Point DetectionTime Series

Similar Papers 제목 키워드 기반

Introduction to Stochastic Differential Equations for Generative Machine Learning: A Variational Perspective

2026-06-30 · Ole Winther, Paul Jeha, Sander Dieleman, Andriy Mnih 외 arxiv

The use of ordinary and stochastic differential equations has led to substantial progress in generative machine learning with applications to, for example, image, video and biomolecule generation. This paper provides a s…

Latent Neural Stochastic Differential Equations for Change Point Detection

2022-08-22 · Artem Ryzhikov, Mikhail Hushchyn, Denis Derkach

Automated analysis of complex systems based on multiple readouts remains a challenge. Change point detection algorithms are aimed to locating abrupt changes in the time series behaviour of a process. In this paper, we pr…

Change Point DetectionTime Series

Neural Stochastic Differential Equations with Change Points: A Generative Adversarial Approach

2023-12-20 · Zhongchang Sun, Yousef El-Laham, Svitlana Vyetrenko

Stochastic differential equations (SDEs) have been widely used to model real world random phenomena. Existing works mainly focus on the case where the time series is modeled by a single SDE, which might be restrictive fo…

Change Point DetectionTime Series

Scalable Gradients for Stochastic Differential Equations

2020-01-05 · Xuechen Li, Ting-Kam Leonard Wong, Ricky T. Q. Chen, David Duvenaud

The adjoint sensitivity method scalably computes gradients of solutions to ordinary differential equations. We generalize this method to stochastic differential equations, allowing time-efficient and constant-memory comp…

SensitivityVariational InferenceVideo Prediction

Scalable Gradients and Variational Inference for Stochastic Differential Equations

2019-10-16 · pproximateinference AABI Symposium 2019 12 · Xuechen Li, Ting-Kam Leonard Wong, Ricky T. Q. Chen, David K. Duvenaud

We derive reverse-mode (or adjoint) automatic differentiation for solutions of stochastic differential equations (SDEs), allowing time-efficient and constant-memory computation of pathwise gradients, a continuous-time an…

Time SeriesTime Series AnalysisVariational Inference