Debiasing Conditional Stochastic Optimization
In this paper, we study the conditional stochastic optimization (CSO) problem which covers a variety of applications including portfolio selection, reinforcement learning, robust learning, causal inference, etc. The sample-averaged gradient of the CSO objective is biased due to its nested structure, and therefore requires a high sample complexity for convergence. We introduce a general stochastic extrapolation technique that effectively reduces the bias. We show that for nonconvex smooth objectives, combining this extrapolation with variance reduction techniques can achieve a significantly better sample complexity than the existing bounds. Additionally, we develop new algorithms for the finite-sum variant of the CSO problem that also significantly improve upon existing results. Finally, we believe that our debiasing technique has the potential to be a useful tool for addressing similar challenges in other stochastic optimization problems.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal InferenceStochastic OptimizationSimilar Papers 제목 키워드 기반
Information-Theoretic Bias Reduction via Causal View of Spurious Correlation
We propose an information-theoretic bias measurement technique through a causal interpretation of spurious correlation, which is effective to identify the feature-level algorithmic bias by taking advantage of conditional…
Face RecognitionFairnessFederated Conditional Stochastic Optimization
Conditional stochastic optimization has found applications in a wide range of machine learning tasks, such as invariant learning, AUPRC maximization, and meta-learning. As the demand for training models with large-scale …
Distributed OptimizationFederated LearningMeta-LearningStochastic OptimizationAutomatic debiasing of neural networks via moment-constrained learning
Causal and nonparametric estimands in economics and biostatistics can often be viewed as the mean of a linear functional applied to an unknown outcome regression function. Naively learning the regression function and tak…
regressionA Functional Model Method for Nonconvex Nonsmooth Conditional Stochastic Optimization
We consider stochastic optimization problems involving an expected value of a nonlinear function of a base random vector and a conditional expectation of another function depending on the base random vector, a dependent …
Stochastic OptimizationStochasticRank: Global Optimization of Scale-Free Discrete Functions
In this paper, we introduce a powerful and efficient framework for direct optimization of ranking metrics. The problem is ill-posed due to the discrete structure of the loss, and to deal with that, we introduce two impor…
global-optimizationLearning-To-Rank