Gradient Weights help Nonparametric Regressors
In regression problems over $\real^d$, the unknown function $f$ often varies more in some coordinates than in others. We show that weighting each coordinate $i$ with the estimated norm of the $i$th derivative of $f$ is an efficient way to significantly improve the performance of distance-based regressors, e.g. kernel and $k$-NN regressors. We propose a simple estimator of these derivative norms and prove its consistency. Moreover, the proposed estimator is efficiently learned online.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionSimilar Papers 제목 키워드 기반
A Bootstrap Specification Test for Semiparametric Models with Generated Regressors
This paper provides a specification test for semiparametric models with nonparametrically generated regressors. Such variables are not observed by the researcher but are nonparametrically identified and estimable. Applic…
validAutomatic Debiased Estimation with Machine Learning-Generated Regressors
Many parameters of interest in economics and other social sciences depend on generated regressors. Examples in economics include structural parameters in models with endogenous variables estimated by control functions an…
counterfactualDimensionality ReductionFeature EngineeringImputationNonparametric Density Estimation for Stochastic Optimization with an Observable State Variable
We study convex stochastic optimization problems where a noisy objective function value is observed after a decision is made. There are many stochastic optimization problems whose behavior depends on an exogenous state v…
Density EstimationStochastic OptimizationEstimating High Dimensional Monotone Index Models by Iterative Convex Optimization1
In this paper we propose new approaches to estimating large dimensional monotone index models. This class of models has been popular in the applied and theoretical econometrics literatures as it includes discrete choice,…
EconometricsVocal Bursts Intensity PredictionPartial Mean Processes with Generated Regressors: Continuous Treatment Effects and Nonseparable Models
Partial mean with generated regressors arises in several econometric problems, such as the distribution of potential outcomes with continuous treatments and the quantile structural function in a nonseparable triangular m…