paper-with-me

Papers

Communication-Constrained Distributed Quantile Regression with Optimal Statistical Guarantees

2021-10-25 · Kean Ming Tan, Heather Battey, Wen-Xin Zhou

We address the problem of how to achieve optimal inference in distributed quantile regression without stringent scaling conditions. This is challenging due to the non-smooth nature of the quantile regression (QR) loss function, which invalidates the use of existing methodology. The difficulties are resolved through a double-smoothing approach that is applied to the local (at each data source) and global objective functions. Despite the reliance on a delicate combination of local and global smoothing parameters, the quantile regression model is fully parametric, thereby facilitating interpretation. In the low-dimensional regime, we establish a finite-sample theoretical framework for the sequentially defined distributed QR estimators. This reveals a trade-off between the communication cost and statistical error. We further discuss and compare several alternative confidence set constructions, based on inversion of Wald and score-type tests and resampling techniques, detailing an improvement that is effective for more extreme quantile coefficients. In high dimensions, a sparse framework is adopted, where the proposed doubly-smoothed objective function is complemented with an $\ell_1$-penalty. We show that the corresponding distributed penalized QR estimator achieves the global convergence rate after a near-constant number of communication rounds. A thorough simulation study further elucidates our findings.

📄 PDF Abstract BibTeX arXiv:2110.13113

Code (0)

등록된 구현이 없습니다.

Tasks

quantile regressionregression

Similar Papers 제목 키워드 기반

High-Dimensional Differentially Private Quantile Regression: Distributed Estimation and Statistical Inference

2025-08-07 · Ziliang Shen, Caixing Wang, Shaoli Wang, Yibo Yan arxiv

With the development of big data and machine learning, privacy concerns have become increasingly critical, especially when handling heterogeneous datasets containing sensitive personal information. Differential privacy p…

Distributed High-Dimensional Quantile Regression: Estimation Efficiency and Support Recovery

2024-05-13 · Caixing Wang, Ziliang Shen

In this paper, we focus on distributed estimation and support recovery for high-dimensional linear quantile regression. Quantile regression is a popular alternative tool to the least squares regression for robustness aga…

quantile regressionregression

Distributed High-dimensional Regression Under a Quantile Loss Function

2019-06-13 · Xi Chen, Weidong Liu, Xiaojun Mao, Zhuoyi Yang

This paper studies distributed estimation and support recovery for high-dimensional linear regression model with heavy-tailed noise. To deal with heavy-tailed noise whose variance can be infinite, we adopt the quantile r…

quantile regressionregressionVocal Bursts Intensity Prediction

Byzantine-Robust Distributed Sparse Learning Revisited

2026-05-13 · Yuxuan Wang, Lixin Zhang, Kangqiang Li arxiv

We revisit Byzantine robust distributed estimation for high-dimensional sparse linear models. By combining local $\ell_1$-regularized robust estimation with robust aggregation at the server, the framework applies to pseu…

Sparse Learning

Vector Quantile Regression on Manifolds

2023-07-03 · Marco Pegoraro, Sanketh Vedula, Aviv A. Rosenberg, Irene Tallini 외

Quantile regression (QR) is a statistical tool for distribution-free estimation of conditional quantiles of a target variable given explanatory features. QR is limited by the assumption that the target distribution is un…

quantile regressionregression