Nonparametric Density Estimation for Stochastic Optimization with an Observable State Variable
We study convex stochastic optimization problems where a noisy objective function value is observed after a decision is made. There are many stochastic optimization problems whose behavior depends on an exogenous state variable which affects the shape of the objective function. Currently, there is no general purpose algorithm to solve this class of problems. We use nonparametric density estimation for the joint distribution of state-outcome pairs to create weights for previous observations. The weights effectively group similar states. Those similar to the current state are used to create a convex, deterministic approximation of the objective function. We propose two solution methods that depend on the problem characteristics: function-based and gradient-based optimization. We offer two weighting schemes, kernel based weights and Dirichlet process based weights, for use with the solution methods. The weights and solution methods are tested on a synthetic multi-product newsvendor problem and the hour ahead wind commitment problem. Our results show Dirichlet process weights can offer substantial benefits over kernel based weights and, more generally, that nonparametric estimation methods provide good solutions to otherwise intractable problems.
Code (0)
등록된 구현이 없습니다.
Tasks
Density EstimationStochastic OptimizationSimilar Papers 제목 키워드 기반
Variational Polya Tree
Density estimation is essential for generative modeling, particularly with the rise of modern neural networks. While existing methods capture complex data distributions, they often lack interpretability and uncertainty q…
Density EstimationEstimation of Conditional Random Coefficient Models using Machine Learning Techniques
Nonparametric random coefficient (RC)-density estimation has mostly been considered in the marginal density case under strict independence of RCs and covariates. This paper deals with the estimation of RC-densities condi…
BIG-bench Machine LearningDensity EstimationA New Nonparametric Estimate of the Risk-Neutral Density with Applications to Variance Swaps
We develop a new nonparametric approach for estimating the risk-neutral density of asset prices and reformulate its estimation into a double-constrained optimization problem. We evaluate our approach using the S\&P 500 m…
Nonparametric Regression with Dyadic Data
This paper studies the identification and estimation of a nonparametric nonseparable dyadic model where the structural function and the distribution of the unobservable random terms are assumed to be unknown. The identif…
regressionNonparametric Density Estimation for High-Dimensional Data - Algorithms and Applications
Density Estimation is one of the central areas of statistics whose purpose is to estimate the probability density function underlying the observed data. It serves as a building block for many tasks in statistical inferen…
BIG-bench Machine LearningClusteringDensity EstimationVocal Bursts Intensity Prediction