Estimation error analysis of deep learning on the regression problem on the variable exponent Besov space
Deep learning has achieved notable success in various fields, including image and speech recognition. One of the factors in the successful performance of deep learning is its high feature extraction ability. In this study, we focus on the adaptivity of deep learning; consequently, we treat the variable exponent Besov space, which has a different smoothness depending on the input location $x$. In other words, the difficulty of the estimation is not uniform within the domain. We analyze the general approximation error of the variable exponent Besov space and the approximation and estimation errors of deep learning. We note that the improvement based on adaptivity is remarkable when the region upon which the target function has less smoothness is small and the dimension is large. Moreover, the superiority to linear estimators is shown with respect to the convergence rate of the estimation error.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Learningspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
High-Dimensional Structured Quantile Regression
Quantile regression aims at modeling the conditional median and quantiles of a response variable given certain predictor variables. In this work we consider the problem of linear quantile regression in high dimensio…
parameter estimationquantile regressionregressionVocal Bursts Intensity PredictionErrors-in-variables Fréchet Regression with Low-rank Covariate Approximation
Fr\'echet regression has emerged as a promising approach for regression analysis involving non-Euclidean response variables. However, its practical applicability has been hindered by its reliance on ideal scenarios with …
regressionErrors-in-variables Fr\'echet Regression with Low-rank Covariate Approximation
Fr\'echet regression has emerged as a promising approach for regression analysis involving non-Euclidean response variables. However, its practical applicability has been hindered by its reliance on ideal scenarios with …
RCR: Robust Compound Regression for Robust Estimation of Errors-in-Variables Model
The errors-in-variables (EIV) regression model, being more realistic by accounting for measurement errors in both the dependent and the independent variables, is widely adopted in applied sciences. The traditional EIV mo…
regressionPredictability Analysis of Regression Problems via Conditional Entropy Estimations
In the field of machine learning, regression problems are pivotal due to their ability to predict continuous outcomes. Traditional error metrics like mean squared error, mean absolute error, and coefficient of determinat…
regression