paper-with-me

Papers

Robust multi-task boosting using clustering and local ensembling

2026-02-15 · Seyedsaman Emami, Daniel Hernández-Lobato, Gonzalo Martínez-Muñoz arxiv

Multi-Task Learning (MTL) aims to boost predictive performance by sharing information across related tasks, yet conventional methods often suffer from negative transfer when unrelated or noisy tasks are forced to share representations. We propose Robust Multi-Task Boosting using Clustering and Local Ensembling (RMB-CLE), a principled MTL framework that integrates error-based task clustering with local ensembling. Unlike prior work that assumes fixed clusters or hand-crafted similarity metrics, RMB-CLE derives inter-task similarity directly from cross-task errors, which admit a risk decomposition into functional mismatch and irreducible noise, providing a theoretically grounded mechanism to prevent negative transfer. Tasks are grouped adaptively via agglomerative clustering, and within each cluster, a local ensemble enables robust knowledge sharing while preserving task-specific patterns. Experiments show that RMB-CLE recovers ground-truth clusters in synthetic data and consistently outperforms multi-task, single-task, and pooling-based ensemble methods across diverse real-world and synthetic benchmarks. These results demonstrate that RMB-CLE is not merely a combination of clustering and boosting but a general and scalable framework that establishes a new basis for robust multi-task learning.

📄 PDF Abstract BibTeX arXiv:2602.14231

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task Learning

Similar Papers 제목 키워드 기반

Multi-Study Boosting: Theoretical Considerations for Merging vs. Ensembling

2022-07-11 · Cathy Shyr, Pragya Sur, Giovanni Parmigiani, Prasad Patil

Cross-study replicability is a powerful model evaluation criterion that emphasizes generalizability of predictions. When training cross-study replicable prediction models, it is critical to decide between merging and tre…

Ensembling Sparse Autoencoders

2025-05-21 · Soham Gadgil, Chris Lin, Su-In Lee

Sparse autoencoders (SAEs) are used to decompose neural network activations into human-interpretable features. Typically, features learned by a single SAE are used for downstream applications. However, it has recently be…

DiversityLanguage ModelingLanguage Modelling

A Novel Multi-clustering Method for Hierarchical Clusterings, Based on Boosting

2018-05-29 · Elaheh Rashedi, Abdolreza Mirzaei

Bagging and boosting are proved to be the best methods of building multiple classifiers in classification combination problems. In the area of "flat clustering" problems, it is also recognized that multi-clustering metho…

Clustering

Uncertainty-Aware Boosted Ensembling in Multi-Modal Settings

2021-04-21 · Utkarsh Sarawgi, Rishab Khincha, Wazeer Zulfikar, Satrajit Ghosh 외

Reliability of machine learning (ML) systems is crucial in safety-critical applications such as healthcare, and uncertainty estimation is a widely researched method to highlight the confidence of ML systems in deployment…

Prediction Intervals

Revisiting ensembling for improving the performance of deep learning models

2022-08-21 · 8th International Workshop Image Mining: Theory and Applications 2022 8 · Antonio Bruno, Davide Moroni, Massimo Martinelli

Ensembling is a very well-known strategy consisting in fusing several different models to achieve a new model for classification or regression tasks. Over the years, ensembling has been proven to provide superior perfor…

Deep LearningImage Classification