Non-parametric Binary regression in metric spaces with KL loss
We propose a non-parametric variant of binary regression, where the hypothesis is regularized to be a Lipschitz function taking a metric space to [0,1] and the loss is logarithmic. This setting presents novel computational and statistical challenges. On the computational front, we derive a novel efficient optimization algorithm based on interior point methods; an attractive feature is that it is parameter-free (i.e., does not require tuning an update step size). On the statistical front, the unbounded loss function presents a problem for classic generalization bounds, based on covering-number and Rademacher techniques. We get around this challenge via an adaptive truncation approach, and also present a lower bound indicating that the truncation is, in some sense, necessary.
Code (0)
등록된 구현이 없습니다.
Tasks
Generalization BoundsregressionSimilar Papers 제목 키워드 기반
Binary Choice with Asymmetric Loss in a Data-Rich Environment: Theory and an Application to Racial Justice
We study the binary choice problem in a data-rich environment with asymmetric loss functions. The econometrics literature covers nonparametric binary choice problems but does not offer computationally attractive solution…
BIG-bench Machine LearningEconometricsregressionvalidBAST: Bayesian Additive Regression Spanning Trees for Complex Constrained Domain
Nonparametric regression on complex domains has been a challenging task as most existing methods, such as ensemble models based on binary decision trees, are not designed to account for intrinsic geometries and domain bo…
Bayesian InferenceregressionSelection consistency of Lasso-based procedures for misspecified high-dimensional binary model and random regressors
We consider selection of random predictors for high-dimensional regression problem with binary response for a general loss function. Important special case is when the binary model is semiparametric and the response func…
regressionMMFace: A Multi-Metric Regression Network for Unconstrained Face Reconstruction
We propose to address the face reconstruction in the wild by using a multi-metric regression network, MMFace, to align a 3D face morphable model (3DMM) to an input image. The key idea is to utilize a volumetric sub-netwo…
Face ReconstructionregressionA Kernelization-Based Approach to Nonparametric Binary Choice Models
We propose a new estimator for nonparametric binary choice models that does not impose a parametric structure on either the systematic function of covariates or the distribution of the error term. A key advantage of our …
Computational EfficiencyDimensionality Reduction