paper-with-me

홈 › Papers

Stochastic Optimization Forests

2020-08-17 · Nathan Kallus, Xiaojie Mao

We study contextual stochastic optimization problems, where we leverage rich auxiliary observations (e.g., product characteristics) to improve decision making with uncertain variables (e.g., demand). We show how to train forest decision policies for this problem by growing trees that choose splits to directly optimize the downstream decision quality, rather than splitting to improve prediction accuracy as in the standard random forest algorithm. We realize this seemingly computationally intractable problem by developing approximate splitting criteria that utilize optimization perturbation analysis to eschew burdensome re-optimization for every candidate split, so that our method scales to large-scale problems. We prove that our splitting criteria consistently approximate the true risk and that our method achieves asymptotic optimality. We extensively validate our method empirically, demonstrating the value of optimization-aware construction of forests and the success of our efficient approximations. We show that our approximate splitting criteria can reduce running time hundredfold, while achieving performance close to forest algorithms that exactly re-optimize for every candidate split.

📄 PDF Abstract BibTeX arXiv:2008.07473

Code (1)

CausalML/StochOptForest 공식 구현

Tasks

Decision MakingStochastic Optimization

Similar Papers 제목 키워드 기반

Decision making in stochastic extensive form I: Stochastic decision forests

2024-04-18 · E. Emanuel Rapsch

A general theory of stochastic decision forests is developed to bridge two concepts of information flow: decision trees and refined partitions on the one side, filtrations from probability theory on the other. Instead of…

Decision MakingForm

Deep Neural Decision Forests

2015-12-01 · ICCV 2015 12 · Peter Kontschieder, Madalina Fiterau, Antonio Criminisi, Samuel Rota Bulo

We present Deep Neural Decision Forests - a novel approach that unifies classification trees with the representation learning functionality known from deep convolutional networks, by training them in an end-to-end manner…

global-optimizationRepresentation Learning

Matrices of forests, analysis of networks, and ranking problems

2013-05-28 · Pavel Chebotarev, Rafig Agaev

The matrices of spanning rooted forests are studied as a tool for analysing the structure of networks and measuring their properties. The problems of revealing the basic bicomponents, measuring vertex proximity, and rank…

Stochastic geometry to generalize the Mondrian Process

2020-02-03 · Eliza O'Reilly, Ngoc Tran

The stable under iterated tessellation (STIT) process is a stochastic process that produces a recursive partition of space with cut directions drawn independently from a distribution over the sphere. The case of random a…

Bayesian OptimizationBIG-bench Machine LearningDensity Estimation

Random Hinge Forest for Differentiable Learning

2018-02-12 · Nathan Lay, Adam P. Harrison, Sharon Schreiber, Gitesh Dawer 외

We propose random hinge forests, a simple, efficient, and novel variant of decision forests. Importantly, random hinge forests can be readily incorporated as a general component within arbitrary computation graphs that a…