paper-with-me

Papers

$(α,β)$-Stability for Boosting Vector-Valued Prediction

2026-02-21 · Jian Qian, Shu Ge arxiv

Despite the widespread use of boosting in structured prediction, a general theoretical understanding of aggregation beyond scalar prediction remains incomplete. We study vector-valued prediction under a target divergence and identify a geometric stability property under which aggregation amplifies weak guarantees into strong ones. We formalize this property as $(α,β)$-stability by geometric median and show how it supports a boosting framework based on exponential reweighting and geometric-median aggregation. For vector-valued prediction, we characterize this stability property under several natural divergences: $\ell_1$ and $\ell_2$ distances for unconstrained vector-valued prediction, and TV, Hellinger, and KL for density estimation over finite probability vectors. Building on these results, we propose a generic boosting framework \geomedboost. Under a weak learner condition and $(α,β)$-stability, we obtain exponential decay of the empirical divergence error, which then yields population guarantees through a generalization bound.

📄 PDF Abstract BibTeX arXiv:2602.18866

Code (0)

등록된 구현이 없습니다.

Tasks

Structured PredictionDensity Estimation

Similar Papers 제목 키워드 기반

Stability of Multi-Task Kernel Regression Algorithms

2013-06-17 · Julien Audiffren, Hachem Kadri

We study the stability properties of nonlinear multi-task regression in reproducing Hilbert spaces with operator-valued kernels. Such kernels, a.k.a. multi-task kernels, are appropriate for learning prob- lems with nonsc…

Multi-Task Learningregression

Gradient boosting with vector-valued leafs

2026-06-28 · David Cortes arxiv

Gradient boosting in the form of decision tree ensembles has successfully been applied to a variety of problems using simple objective functions based on log-likelihoods of a single variable. The concept extends naturall…

Multi-class Classification

Boosted p-Values for High-Dimensional Vector Autoregression

2022-11-04 · Xiao Huang

Assessing the statistical significance of parameter estimates is an important step in high-dimensional vector autoregression modeling. Using the least-squares boosting method, we compute the p-value for each selected par…

Time SeriesTime Series AnalysisvalidVocal Bursts Intensity Prediction

Compact Multi-Class Boosted Trees

2017-10-31 · Natalia Ponomareva, Thomas Colthurst, Gilbert Hendry, Salem Haykal 외

Gradient boosted decision trees are a popular machine learning technique, in part because of their ability to give good accuracy with small models. We describe two extensions to the standard tree boosting algorithm desig…

The return of AdaBoost.MH: multi-class Hamming trees

2013-12-20 · Balázs Kégl

Within the framework of AdaBoost.MH, we propose to train vector-valued decision trees to optimize the multi-class edge without reducing the multi-class problem to $K$ binary one-against-all classifications. The key eleme…

Computational Efficiency