Active Regression by Stratification
We propose a new active learning algorithm for parametric linear regression with random design. We provide finite sample convergence guarantees for general distributions in the misspecified model. This is the first active learner for this setting that provably can improve over passive learning. Unlike other learning settings (such as classification), in regression the passive learning rate of $O(1/\epsilon)$ cannot in general be improved upon. Nonetheless, the so-called `constant' in the rate of convergence, which is characterized by a distribution-dependent risk, can be improved in many cases. For a given distribution, achieving the optimal risk requires prior knowledge of the distribution. Following the stratification technique advocated in Monte-Carlo function integration, our active learner approaches the optimal risk using piecewise constant approximations.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningGeneral ClassificationregressionSimilar Papers 제목 키워드 기반
Evaluation of adaptive sampling methods in scenario generation for virtual safety impact assessment of pre-crash safety systems
Virtual safety assessment plays a vital role in evaluating the safety impact of pre-crash safety systems such as advanced driver assistance systems (ADAS) and automated driving systems (ADS). However, as the number of pa…
Computational EfficiencyCPUCovariate Adjustment in Stratified Experiments
This paper studies covariate adjusted estimation of the average treatment effect in stratified experiments. We work in a general framework that includes matched tuples designs, coarse stratification, and complete randomi…
regressionFeature selection in stratification estimators of causal effects: lessons from potential outcomes, causal diagrams, and structural equations
What is the ideal regression (if any) for estimating average causal effects? We study this question in the setting of discrete covariates, deriving expressions for the finite-sample variance of various stratification est…
feature selectionregressionDevelopment of Interactive Nomograms for Predicting Short-Term Survival in ICU Patients with Aplastic Anemia
Aplastic anemia is a rare, life-threatening hematologic disorder characterized by pancytopenia and bone marrow failure. ICU admission in these patients often signals critical complications or disease progression, making …
Decision Makingfeature selectionICU AdmissionregressionActive manifolds, stratifications, and convergence to local minima in nonsmooth optimization
We show that the subgradient method converges only to local minimizers when applied to generic Lipschitz continuous and subdifferentially regular functions that are definable in an o-minimal structure. At a high level, t…