paper-with-me

홈 › Papers

A Divergence-Based Method for Weighting and Averaging Model Predictions

2026-04-27 · Olav Benjamin Vassend arxiv

This paper uses a minimum divergence framework to introduce a new way of calculating model weights that can be used to average probabilistic predictions from statistical and machine learning models. The method is general and can be applied regardless of whether the models under consideration are fit to data using frequentist, Bayesian, or some other fitting method. The proposed method is motivated in two different ways and is shown empirically to perform better than or on a par with standard model averaging methods, including model stacking and model averaging that relies on Akaike-style negative exponentiated model weighting, especially when the sample size is small. Our theoretical analysis explains why the method has a small-sample advantage.

📄 PDF Abstract BibTeX arXiv:2604.24172

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Beyond Bayesian Model Averaging over Paths in Probabilistic Programs with Stochastic Support

2023-10-23 · Tim Reichelt, Luke Ong, Tom Rainforth

The posterior in probabilistic programs with stochastic support decomposes as a weighted sum of the local posterior distributions associated with each possible program path. We show that making predictions with this full…

RRMSE Voting Regressor: A weighting function based improvement to ensemble regression

2022-07-11 · Shikun Chen, Nguyen Manh Luc

This paper describes the RRMSE (Relative Root Mean Square Error) based weights to weight the occurrences of predictive values before averaging for the ensemble voting regression. The core idea behind ensemble regression …

regression

Weighting Model Based on Group Dynamics to Measure Convergence in Multi-party Dialogue

2018-07-01 · WS 2018 7 · Zahra Rahimi, Diane Litman

This paper proposes a new weighting method for extending a dyad-level measure of convergence to multi-party dialogues by considering group dynamics instead of simply averaging. Experiments indicate the usefulness of the …

Test-time Collective Prediction

2021-06-22 · NeurIPS 2021 12 · Celestine Mendler-Dünner, Wenshuo Guo, Stephen Bates, Michael I. Jordan

An increasingly common setting in machine learning involves multiple parties, each with their own data, who want to jointly make predictions on future test points. Agents wish to benefit from the collective expertise of …

Prediction

Beyond Simple Averaging: Improving NLP Ensemble Performance with Topological-Data-Analysis-Based Weighting

2024-02-22 · Polina Proskura, Alexey Zaytsev

In machine learning, ensembles are important tools for improving the model performance. In natural language processing specifically, ensembles boost the performance of a method due to multiple large models available in o…

Diversitytext-classificationText ClassificationTopological Data Analysis