paper-with-me

Papers

Sequential sparse Gaussian process quantile regression

2026-06-30 · Hugo Nicolas, Olivier Le Maître arxiv

Quantile regression aims to estimate the conditional quantiles of a response variable from observed data. In a Bayesian setting, Gaussian process quantile regression provides uncertainty quantification but faces significant computational challenges due to the nonconjugacy of the asymmetric Laplace likelihood and the cost of posterior inference. We develop a sparse Gaussian process framework in which the quantile function is represented through a reduced set of inducing variables and posterior inference is performed using a Laplace approximation. A decomposition of the predictive uncertainty into conditional-prior and posterior-induced variance components is then exploited to drive two complementary adaptive mechanisms: inducing-input infilling and data acquisition. These mechanisms are combined within a sequential algorithm that allocates computational effort toward the dominant source of predictive uncertainty and adaptively controls model complexity. Numerical experiments on benchmark problems demonstrate the accuracy of the Laplace approximation, the benefits of variance-based inducing-input placement, and the effectiveness of the proposed sequential enrichment strategy compared with predefined data-acquisition strategies.

📄 PDF Abstract BibTeX arXiv:2606.31284

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Adaptive Iterative Hard Thresholding for Online High-dimensional Quantile Regression

2026-06-26 · Zitian Zhou, Nan Lin arxiv

Online high-dimensional regression requires algorithms that can update sequentially while preserving structural sparsity. We propose \textit{Adaptive Iterative Hard Thresholding (AIHT)}, an online sparse-regression frame…

Enhancing Performance and Calibration in Quantile Hyperparameter Optimization

2025-09-21 · Riccardo Doyle arxiv

Bayesian hyperparameter optimization relies heavily on Gaussian Process (GP) surrogates, due to robust distributional posteriors and strong performance on limited training samples. GPs however underperform in categorical…

Hyperparameter Optimization

Communication-Constrained Distributed Quantile Regression with Optimal Statistical Guarantees

2021-10-25 · Kean Ming Tan, Heather Battey, Wen-Xin Zhou

We address the problem of how to achieve optimal inference in distributed quantile regression without stringent scaling conditions. This is challenging due to the non-smooth nature of the quantile regression (QR) loss fu…

quantile regressionregression

Adaptive Conditional Quantile Neural Processes

2023-05-30 · Peiman Mohseni, Nick Duffield, Bani Mallick, Arman Hasanzadeh

Neural processes are a family of probabilistic models that inherit the flexibility of neural networks to parameterize stochastic processes. Despite providing well-calibrated predictions, especially in regression problems…

Image InpaintingMeta-Learningquantile regressionregression

Smoothing ADMM for Sparse-Penalized Quantile Regression with Non-Convex Penalties

2023-09-04 · Reza Mirzaeifard, Naveen K. D. Venkategowda, Vinay Chakravarthi Gogineni, Stefan Werner

This paper investigates quantile regression in the presence of non-convex and non-smooth sparse penalties, such as the minimax concave penalty (MCP) and smoothly clipped absolute deviation (SCAD). The non-smooth and non-…

quantile regressionregression