Machine Learning for Multi-Output Regression: When should a holistic multivariate approach be preferred over separate univariate ones?
Tree-based ensembles such as the Random Forest are modern classics among statistical learning methods. In particular, they are used for predicting univariate responses. In case of multiple outputs the question arises whether we separately fit univariate models or directly follow a multivariate approach. For the latter, several possibilities exist that are, e.g. based on modified splitting or stopping rules for multi-output regression. In this work we compare these methods in extensive simulations to help in answering the primary question when to use multivariate ensemble techniques.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionSimilar Papers 제목 키워드 기반
Policy Trees for Prediction: Interpretable and Adaptive Model Selection for Machine Learning
As a multitude of capable machine learning (ML) models become widely available in forms such as open-source software and public APIs, central questions remain regarding their use in real-world applications, especially in…
Decision MakingModel SelectionCovariate Balancing and Riesz Regression Should Be Guided by the Neyman Orthogonal Score in Debiased Machine Learning
This position paper argues that, in debiased machine learning, balancing functions should be derived from the Neyman orthogonal score, not chosen only as functions of covariates. Covariate balancing is effective when the…
Are Linear Regression Models White Box and Interpretable?
Explainable artificial intelligence (XAI) is a set of tools and algorithms that applied or embedded to machine learning models to understand and interpret the models. They are recommended especially for complex or advanc…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)FairnessregressionAnalytical results for uncertainty propagation through trained machine learning regression models
Machine learning (ML) models are increasingly being used in metrology applications. However, for ML models to be credible in a metrology context they should be accompanied by principled uncertainty quantification. This p…
Computational EfficiencyGaussian ProcessesregressionUncertainty QuantificationCombining Prediction Intervals on Multi-Source Non-Disclosed Regression Datasets
Conformal Prediction is a framework that produces prediction intervals based on the output from a machine learning algorithm. In this paper we explore the case when training data is made up of multiple parts available in…
BIG-bench Machine LearningConformal PredictionPredictionPrediction Intervals+2