paper-with-me

홈 › Papers

fastkqr: A Fast Algorithm for Kernel Quantile Regression

2024-08-10 · Qian Tang, Yuwen Gu, Boxiang Wang

Quantile regression is a powerful tool for robust and heterogeneous learning that has seen applications in a diverse range of applied areas. However, its broader application is often hindered by the substantial computational demands arising from the non-smooth quantile loss function. In this paper, we introduce a novel algorithm named fastkqr, which significantly advances the computation of quantile regression in reproducing kernel Hilbert spaces. The core of fastkqr is a finite smoothing algorithm that magically produces exact regression quantiles, rather than approximations. To further accelerate the algorithm, we equip fastkqr with a novel spectral technique that carefully reutilizes matrix computations. In addition, we extend fastkqr to accommodate a flexible kernel quantile regression with a data-driven crossing penalty, addressing the interpretability challenges of crossing quantile curves at multiple levels. We have implemented fastkqr in a publicly available R package. Extensive simulations and real applications show that fastkqr matches the accuracy of state-of-the-art algorithms but can operate up to an order of magnitude faster.

📄 PDF Abstract BibTeX arXiv:2408.05393

Code (0)

등록된 구현이 없습니다.

Tasks

quantile regressionregression

Similar Papers 제목 키워드 기반

A Pathwise Coordinate Descent Algorithm for LASSO Penalized Quantile Regression

2025-02-17 · Sanghee Kim, Sumanta Basu

$\ell_1$ penalized quantile regression is used in many fields as an alternative to penalized least squares regressions for high-dimensional data analysis. Existing algorithms for penalized quantile regression either use …

quantile regressionregression

Joint quantile regression in vector-valued RKHSs

2016-12-01 · NeurIPS 2016 12 · Maxime Sangnier, Olivier Fercoq, Florence d'Alché-Buc

Addressing the will to give a more complete picture than an average relationship provided by standard regression, a novel framework for estimating and predicting simultaneously several conditional quantiles is introduced…

Multi-Task Learningquantile regressionregression

Learning rates for the risk of kernel based quantile regression estimators in additive models

2014-05-14 · Andreas Christmann, Ding-Xuan Zhou

Additive models play an important role in semiparametric statistics. This paper gives learning rates for regularized kernel based methods for additive models. These learning rates compare favourably in particular in high…

Additive modelsquantile regressionregressionvalid

Fast Kernel Methods for Generic Lipschitz Losses via $p$-Sparsified Sketches

2022-06-08 · Tamim El Ahmad, Pierre Laforgue, Florence d'Alché-Buc

Kernel methods are learning algorithms that enjoy solid theoretical foundations while suffering from important computational limitations. Sketching, which consists in looking for solutions among a subspace of reduced dim…

quantile regressionregressionvalid

Nearly Linear Row Sampling Algorithm for Quantile Regression

2020-06-15 · ICML 2020 1 · Yi Li, Ruosong Wang, Lin Yang, Hanrui Zhang

We give a row sampling algorithm for the quantile loss function with sample complexity nearly linear in the dimensionality of the data, improving upon the previous best algorithm whose sampling complexity has at least cu…

quantile regressionregression