Inspectable Neural Markov Models for Non-Stationary Time Series
Modeling non-stationary stochastic systems requires balancing the representational capacity of deep learning with the structural transparency of classical probabilistic models. Markov transition matrices provide such a framework, but traditional frequency-based estimation collapses at high resolutions due to data sparsity. We propose a hybrid approach that parameterizes the manifold of stochastic matrices through a neural network, enabling estimation of time-inhomogeneous Markov chains in sparse-data regimes, and use financial markets as a testbed to investigate the Markov state variable as a critical inductive bias. We show that conditioning on realized volatility produces a more internally consistent Markovian structure than return-based states, achieving a $5.6\%$ reduction in Chapman-Kolmogorov discrepancy and superior held-out likelihood in 9 of 10 assets. Unlike black-box sequence models, our approach generates explicit matrices amenable to direct geometric analysis, surfacing structural findings such as the universal homogenization of transition probabilities under high-volatility regimes.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Exponential inequalities for nonstationary Markov Chains
Exponential inequalities are main tools in machine learning theory. To prove exponential inequalities for non i.i.d random variables allows to extend many learning techniques to these variables. Indeed, much work has bee…
Learning TheoryTime SeriesTime Series AnalysisAnalysis of Nonstationary Time Series Using Locally Coupled Gaussian Processes
The analysis of nonstationary time series is of great importance in many scientific fields such as physics and neuroscience. In recent years, Gaussian process regression has attracted substantial attention as a robust an…
Gaussian ProcessesTime SeriesTime Series AnalysisIdentifying Unique Causal Network from Nonstationary Time Series
Identifying causality is a challenging task in many data-intensive scenarios. Many algorithms have been proposed for this critical task. However, most of them consider the learning algorithms for directed acyclic graph (…
Time SeriesTime Series AnalysisIdentifying Nonstationary Causal Structures with High-Order Markov Switching Models
Causal discovery in time series is a rapidly evolving field with a wide variety of applications in other areas such as climate science and neuroscience. Traditional approaches assume a stationary causal graph, which can …
Causal DiscoveryTime SeriesMarkovian RNN: An Adaptive Time Series Prediction Network with HMM-based Switching for Nonstationary Environments
We investigate nonlinear regression for nonstationary sequential data. In most real-life applications such as business domains including finance, retail, energy and economy, timeseries data exhibits nonstationarity due t…
Time SeriesTime Series AnalysisTime Series Prediction