paper-with-me

Papers

Semi-supervised learning for linear extremile regression

2025-07-02 · Rong Jiang, Keming Yu, Jiangfeng Wang arxiv

Extremile regression, as a least squares analog of quantile regression, is potentially useful tool for modeling and understanding the extreme tails of a distribution. However, existing extremile regression methods, as nonparametric approaches, may face challenges in high-dimensional settings due to data sparsity, computational inefficiency, and the risk of overfitting. While linear regression serves as the foundation for many other statistical and machine learning models due to its simplicity, interpretability, and relatively easy implementation, particularly in high-dimensional settings, this paper introduces a novel definition of linear extremile regression along with an accompanying estimation methodology. The regression coefficient estimators of this method achieve $\sqrt{n}$-consistency, which nonparametric extremile regression may not provide. In particular, while semi-supervised learning can leverage unlabeled data to make more accurate predictions and avoid overfitting to small labeled datasets in high-dimensional spaces, we propose a semi-supervised learning approach to enhance estimation efficiency, even when the specified linear extremile regression model may be misspecified. Both simulation studies and real data analyses demonstrate the finite-sample performance of our proposed methods.

📄 PDF Abstract BibTeX arXiv:2507.01314

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Semi-supervised Regression using Hessian energy with an application to semi-supervised dimensionality reduction

2009-12-01 · NeurIPS 2009 12 · Kwang I. Kim, Florian Steinke, Matthias Hein

Semi-supervised regression based on the graph Laplacian suffers from the fact that the solution is biased towards a constant and the lack of extrapolating power. Outgoing from these observations we propose to use the sec…

Dimensionality ReductionregressionSupervised dimensionality reduction

Semi-supervised structured output prediction by local linear regression and sub-gradient descent

2016-06-07 · Ru-Ze Liang, Wei Xie, Weizhi Li, Xin Du 외

We propose a novel semi-supervised structured output prediction method based on local linear regression in this paper. The existing semi-supervise structured output prediction methods learn a global predictor for all the…

PredictionregressionStructured Prediction

A Simple Algorithm for Semi-supervised Learning with Improved Generalization Error Bound

2012-06-27 · Ming Ji, Tianbao Yang, Binbin Lin, Rong Jin 외

In this work, we develop a simple algorithm for semi-supervised regression. The key idea is to use the top eigenfunctions of integral operator derived from both labeled and unlabeled examples as the basis functions and l…

regression

Semi-Supervised Empirical Risk Minimization: Using unlabeled data to improve prediction

2020-09-01 · Oren Yuval, Saharon Rosset

We present a general methodology for using unlabeled data to design semi supervised learning (SSL) variants of the Empirical Risk Minimization (ERM) learning process. Focusing on generalized linear regression, we analyze…

regression

Semi-supervised Regression via Parallel Field Regularization

2011-12-01 · NeurIPS 2011 12 · Binbin Lin, Chiyuan Zhang, Xiaofei He

This paper studies the problem of semi-supervised learning from the vector field perspective. Many of the existing work use the graph Laplacian to ensure the smoothness of the prediction function on the data manifold. Ho…

regression