paper-with-me

홈 › Papers

The cost of ensembling: is it always worth combining?

2025-06-05 · Marco Zanotti

Given the continuous increase in dataset sizes and the complexity of forecasting models, the trade-off between forecast accuracy and computational cost is emerging as an extremely relevant topic, especially in the context of ensemble learning for time series forecasting. To asses it, we evaluated ten base models and eight ensemble configurations across two large-scale retail datasets (M5 and VN1), considering both point and probabilistic accuracy under varying retraining frequencies. We showed that ensembles consistently improve forecasting performance, particularly in probabilistic settings. However, these gains come at a substantial computational cost, especially for larger, accuracy-driven ensembles. We found that reducing retraining frequency significantly lowers costs, with minimal impact on accuracy, particularly for point forecasts. Moreover, efficiency-driven ensembles offer a strong balance, achieving competitive accuracy with considerably lower costs compared to accuracy-optimized combinations. Most importantly, small ensembles of two or three models are often sufficient to achieve near-optimal results. These findings provide practical guidelines for deploying scalable and cost-efficient forecasting systems, supporting the broader goals of sustainable AI in forecasting. Overall, this work shows that careful ensemble design and retraining strategy selection can yield accurate, robust, and cost-effective forecasts suitable for real-world applications.

📄 PDF Abstract BibTeX arXiv:2506.04677

Code (0)

등록된 구현이 없습니다.

Tasks

Ensemble LearningTime Series Forecasting

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Two Heads are Better than One? Verification of Ensemble Effect in Neural Machine Translation

2021-11-01 · EMNLP (insights) 2021 11 · Chanjun Park, Sungjin Park, Seolhwa Lee, Taesun Whang 외

In the field of natural language processing, ensembles are broadly known to be effective in improving performance. This paper analyzes how ensemble of neural machine translation (NMT) models affect performance improvemen…

Machine TranslationNMTTranslation

Self-Consistency from Only Two Samples: CoT-PoT Ensembling for Efficient LLM Reasoning

2026-04-19 · Raman Saparkhan, Majd Hawasly, Md Rizwan Parvez, Mohammad Raza arxiv

Self-consistency (SC) is a popular technique for improving the reasoning accuracy of large language models by aggregating multiple sampled outputs, but it comes at a high computational cost due to extensive sampling. We …

PopulAtion Parameter Averaging (PAPA)

2023-04-06 · Alexia Jolicoeur-Martineau, Emy Gervais, Kilian Fatras, Yan Zhang 외

Ensemble methods combine the predictions of multiple models to improve performance, but they require significantly higher computation costs at inference time. To avoid these costs, multiple neural networks can be combine…

Supervised and Unsupervised Ensembling for Knowledge Base Population

2016-04-16 · Nazneen Fatema Rajani, Raymond J. Mooney

We present results on combining supervised and unsupervised methods to ensemble multiple systems for two popular Knowledge Base Population (KBP) tasks, Cold Start Slot Filling (CSSF) and Tri-lingual Entity Discovery and …

Knowledge Base Populationslot-fillingSlot Filling

Fast and Accurate Inference with Adaptive Ensemble Prediction for Deep Networks

2018-01-01 · ICLR 2018 1 · Hiroshi Inoue

Ensembling multiple predictions is a widely-used technique to improve the accuracy of various machine learning tasks. In image classification tasks, for example, averaging the predictions for multiple patches extracted f…

image-classificationImage Classification