Learning Quantile Functions without Quantile Crossing for Distribution-free Time Series Forecasting
Quantile regression is an effective technique to quantify uncertainty, fit challenging underlying distributions, and often provide full probabilistic predictions through joint learnings over multiple quantile levels. A common drawback of these joint quantile regressions, however, is \textit{quantile crossing}, which violates the desirable monotone property of the conditional quantile function. In this work, we propose the Incremental (Spline) Quantile Functions I(S)QF, a flexible and efficient distribution-free quantile estimation framework that resolves quantile crossing with a simple neural network layer. Moreover, I(S)QF inter/extrapolate to predict arbitrary quantile levels that differ from the underlying training ones. Equipped with the analytical evaluation of the continuous ranked probability score of I(S)QF representations, we apply our methods to NN-based times series forecasting cases, where the savings of the expensive re-training costs for non-trained quantile levels is particularly significant. We also provide a generalization error analysis of our proposed approaches under the sequence-to-sequence setting. Lastly, extensive experiments demonstrate the improvement of consistency and accuracy errors over other baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
quantile regressionTime SeriesTime Series AnalysisTime Series ForecastingSimilar Papers 제목 키워드 기반
Deep Distributional Learning with Non-crossing Quantile Network
In this paper, we introduce a non-crossing quantile (NQ) network for conditional distribution learning. By leveraging non-negative activation functions, the NQ network ensures that the learned distributions remain monoto…
Distributional Reinforcement Learningquantile regressionReinforcement Learning (RL)Distributional Reinforcement Learning with Monotonic Splines
Distributional Reinforcement Learning (RL) differs from traditional RL by estimating the distribution over returns to capture the intrinsic uncertainty of MDPs. One key challenge in distributional RL lies in how to param…
Distributional Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)A PyTorch Framework for Scalable Non-Crossing Quantile Regression
Quantile regression is fundamental to distributional modeling, yet independent estimation of multiple quantiles frequently produces crossing -- where estimated quantile functions violate monotonicity, implying impossible…
Crossing-Free Probabilistic K-Line Forecasts Without Retraining
Probabilistic K-line forecasting describes uncertainty in four complementary prices, namely open--high--low--close (OHLC). However, it introduces two consistency problems: quantile crossing and K-line crossing. Quantile …
Non-Crossing Deep Quantile Regression for Distributional Survival Prediction
In survival analysis the way covariates act on the risk of an event often differs between early and late failure times, yet hazard- and mean-based summaries collapse this variation into a single number. Quantile-based mo…