Conditional Risk Minimization for Stochastic Processes
We study the task of learning from non-i.i.d. data. In particular, we aim at learning predictors that minimize the conditional risk for a stochastic process, i.e. the expected loss of the predictor on the next point conditioned on the set of training samples observed so far. For non-i.i.d. data, the training set contains information about the upcoming samples, so learning with respect to the conditional distribution can be expected to yield better predictors than one obtains from the classical setting of minimizing the marginal risk. Our main contribution is a practical estimator for the conditional risk based on the theory of non-parametric time-series prediction, and a finite sample concentration bound that establishes uniform convergence of the estimator to the true conditional risk under certain regularity assumptions on the process.
Code (0)
등록된 구현이 없습니다.
Tasks
Time SeriesTime Series AnalysisTime Series PredictionSimilar Papers 제목 키워드 기반
Adaptive Sampling for Stochastic Risk-Averse Learning
In high-stakes machine learning applications, it is crucial to not only perform well on average, but also when restricted to difficult examples. To address this, we consider the problem of training models in a risk-avers…
Point ProcessesConstrained Quadratic Risk Minimization via Forward and Backward Stochastic Differential Equations
In this paper we study a continuous-time stochastic linear quadratic control problem arising from mathematical finance. We model the asset dynamics with random market coefficients and portfolio strategies with convex con…
Support Vector Regression: Risk Quadrangle Framework
This paper investigates Support Vector Regression (SVR) within the framework of the Risk Quadrangle (RQ) theory. Every RQ includes four stochastic functionals -- error, regret, risk, and \emph{deviation}, bound together …
ManagementregressionStochastic OptimizationLearning theory estimates with observations from general stationary stochastic processes
This paper investigates the supervised learning problem with observations drawn from certain general stationary stochastic processes. Here by \emph{general}, we mean that many stationary stochastic processes can be inclu…
Learning Theoryquantile regressionStochastic measure distortions induced by quantile processes for risk quantification and valuation
We develop a novel stochastic valuation and premium calculation principle based on probability measure distortions that are induced by quantile processes in continuous time. Necessary and sufficient conditions are derive…