Estimation of Non-Crossing Quantile Regression Process with Deep ReQU Neural Networks
We propose a penalized nonparametric approach to estimating the quantile regression process (QRP) in a nonseparable model using rectifier quadratic unit (ReQU) activated deep neural networks and introduce a novel penalty function to enforce non-crossing of quantile regression curves. We establish the non-asymptotic excess risk bounds for the estimated QRP and derive the mean integrated squared error for the estimated QRP under mild smoothness and regularity conditions. To establish these non-asymptotic risk and estimation error bounds, we also develop a new error bound for approximating $C^s$ smooth functions with $s >0$ and their derivatives using ReQU activated neural networks. This is a new approximation result for ReQU networks and is of independent interest and may be useful in other problems. Our numerical experiments demonstrate that the proposed method is competitive with or outperforms two existing methods, including methods using reproducing kernels and random forests, for nonparametric quantile regression.
Code (0)
등록된 구현이 없습니다.
Tasks
quantile regressionregressionSimilar Papers 제목 키워드 기반
A PyTorch Framework for Scalable Non-Crossing Quantile Regression
Quantile regression is fundamental to distributional modeling, yet independent estimation of multiple quantiles frequently produces crossing -- where estimated quantile functions violate monotonicity, implying impossible…
Fused LASSO as Non-Crossing Quantile Regression
Growth-at-Risk is vital for empirical macroeconomics but is often suspect to quantile crossing due to data limitations. While existing literature addresses this through post-processing of the fitted quantiles, these meth…
quantile regressionregressionSolution to the Non-Monotonicity and Crossing Problems in Quantile Regression
This paper proposes a new method to address the long-standing problem of lack of monotonicity in estimation of the conditional and structural quantile function, also known as quantile crossing problem. Quantile regressio…
Econometricsquantile regressionregressionJoint quantile regression in vector-valued RKHSs
Addressing the will to give a more complete picture than an average relationship provided by standard regression, a novel framework for estimating and predicting simultaneously several conditional quantiles is introduced…
Multi-Task Learningquantile regressionregressionAn Efficient Multi Quantile Regression Network with Ad Hoc Prevention of Quantile Crossing
This article presents the Sorting Composite Quantile Regression Neural Network (SCQRNN), an advanced quantile regression model designed to prevent quantile crossing and enhance computational efficiency. Integrating ad ho…
Computational Efficiencyquantile regressionregression