Nonparametric Functional Analysis of Generalized Linear Models Under Nonlinear Constraints
This article introduces a novel nonparametric methodology for Generalized Linear Models which combines the strengths of the binary regression and latent variable formulations for categorical data, while overcoming their disadvantages. Requiring minimal assumptions, it extends recently published parametric versions of the methodology and generalizes it. If the underlying data generating process is asymmetric, it gives uniformly better prediction and inference performance over the parametric formulation. Furthermore, it introduces a new classification statistic utilizing which I show that overall, it has better model fit, inference and classification performance than the parametric version, and the difference in performance is statistically significant especially if the data generating process is asymmetric. In addition, the methodology can be used to perform model diagnostics for any model specification. This is a highly useful result, and it extends existing work for categorical model diagnostics broadly across the sciences. The mathematical results also highlight important new findings regarding the interplay of statistical significance and scientific significance. Finally, the methodology is applied to various real-world datasets to show that it may outperform widely used existing models, including Random Forests and Deep Neural Networks with very few iterations.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Optimal prediction for kernel-based semi-functional linear regression
In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that…
PredictionregressionNonparametric Stochastic Analysis of Dynamic Frequency in Power Systems: A Generalized Ito Process Model
The large-scale integration of intermittent renewable energy has brought serious challenges to the frequency security of power systems. In this paper, a novel nonparametric stochastic analysis method of system dynamic fr…
Learning Functional Graphs with Nonlinear Sufficient Dimension Reduction
Functional graphical models have undergone extensive development during the recent years, leading to a variety models such as the functional Gaussian graphical model, the functional copula Gaussian graphical model, the f…
Nonlinear variable selection with continuous outcome: a nonparametric incremental forward stagewise approach
We present a method of variable selection for the sparse generalized additive model. The method doesn't assume any specific functional form, and can select from a large number of candidates. It takes the form of incremen…
BIG-bench Machine LearningFormregressionVariable SelectionNonparametric Instrumental Variable Inference with Many Weak Instruments
We study inference on linear functionals in the nonparametric instrumental variable (NPIV) problem with a discretely-valued instrument under a many-weak-instruments asymptotic regime, where the number of instrument value…