paper-with-me

홈 › Papers

Estimates on Learning Rates for Multi-Penalty Distribution Regression

2020-06-16 · Zhan Yu, Daniel W. C. Ho

This paper is concerned with functional learning by utilizing two-stage sampled distribution regression. We study a multi-penalty regularization algorithm for distribution regression under the framework of learning theory. The algorithm aims at regressing to real valued outputs from probability measures. The theoretical analysis on distribution regression is far from maturity and quite challenging, since only second stage samples are observable in practical setting. In the algorithm, to transform information from samples, we embed the distributions to a reproducing kernel Hilbert space $\mathcal{H}_K$ associated with Mercer kernel $K$ via mean embedding technique. The main contribution of the paper is to present a novel multi-penalty regularization algorithm to capture more features of distribution regression and derive optimal learning rates for the algorithm. The work also derives learning rates for distribution regression in the nonstandard setting $f_{\rho}\notin\mathcal{H}_K$, which is not explored in existing literature. Moreover, we propose a distribution regression-based distributed learning algorithm to face large-scale data or information challenge. The optimal learning rates are derived for the distributed learning algorithm. By providing new algorithms and showing their learning rates, we improve the existing work in different aspects in the literature.

📄 PDF Abstract BibTeX arXiv:2006.09017

Code (0)

등록된 구현이 없습니다.

Tasks

Learning Theoryregression

Similar Papers 제목 키워드 기반

Multi-task Learning for Gaussian Graphical Regressions with High Dimensional Covariates

2022-05-21 · Jingfei Zhang, Yi Li

Gaussian graphical regression is a powerful means that regresses the precision matrix of a Gaussian graphical model on covariates, permitting the numbers of the response variables and covariates to far exceed the sample …

Multi-Task LearningregressionVocal Bursts Intensity Prediction

Hinge-Wasserstein: Estimating Multimodal Aleatoric Uncertainty in Regression Tasks

2023-06-01 · Ziliang Xiong, Arvi Jonnarth, Abdelrahman Eldesokey, Joakim Johnander 외

Computer vision systems that are deployed in safety-critical applications need to quantify their output uncertainty. We study regression from images to parameter values and here it is common to detect uncertainty by pred…

Density EstimationDisparity EstimationHorizon Line EstimationLine Detection+2

Data-driven calibration of linear estimators with minimal penalties

2009-12-01 · NeurIPS 2009 12 · Sylvain Arlot, Francis R. Bach

This paper tackles the problem of selecting among several linear estimators in non-parametric regression; this includes model selection for linear regression, the choice of a regularization parameter in kernel ridge regr…

Model Selectionregression

Prediction Intervals: Split Normal Mixture from Quality-Driven Deep Ensembles

2020-07-19 · Tárik S. Salem, Helge Langseth, Heri Ramampiaro

Prediction intervals are a machine- and human-interpretable way to represent predictive uncertainty in a regression analysis. In this paper, we present a method for generating prediction intervals along with point estima…

PredictionPrediction Intervals

Achieving Fairness with a Simple Ridge Penalty

2021-05-18 · Marco Scutari, Francesca Panero, Manuel Proissl

In this paper we present a general framework for estimating regression models subject to a user-defined level of fairness. We enforce fairness as a model selection step in which we choose the value of a ridge penalty to …

FairnessModel Selectionregression