Posterior Dispersion Indices
Probabilistic modeling is cyclical: we specify a model, infer its posterior, and evaluate its performance. Evaluation drives the cycle, as we revise our model based on how it performs. This requires a metric. Traditionally, predictive accuracy prevails. Yet, predictive accuracy does not tell the whole story. We propose to evaluate a model through posterior dispersion. The idea is to analyze how each datapoint fares in relation to posterior uncertainty around the hidden structure. We propose a family of posterior dispersion indices (PDI) that capture this idea. A PDI identifies rich patterns of model mismatch in three real data examples: voting preferences, supermarket shopping, and population genetics.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Evaluating Bayesian Models with Posterior Dispersion Indices
Probabilistic modeling is cyclical: we specify a model, infer its posterior, and evaluate its performance. Evaluation drives the cycle, as we revise our model based on how it performs. This requires a metric. Tradit…
Microscopic Propagator Imaging (MPI) with Diffusion MRI
We propose Microscopic Propagator Imaging (MPI) as a novel method to retrieve the indices of the microscopic propagator which is the probability density function of water displacements due to diffusion within the nervous…
Diffusion MRIOn Posterior Collapse and Encoder Feature Dispersion in Sequence VAEs
Variational autoencoders (VAEs) hold great potential for modelling text, as they could in theory separate high-level semantic and syntactic properties from local regularities of natural language. Practically, however, VA…
Language ModelingLanguage ModellingInternational Comparisons: Multilateral Indices and Nonparametric Welfare Bounds
Multilateral index numbers, such as those used to make international comparisons of prices and income, are fundamental objects in economics. However, these numbers are often challenging to interpret in terms of economic …
Interpretable Machine Learning for Macro Alpha: A News Sentiment Case Study
This study introduces an interpretable machine learning (ML) framework to extract macroeconomic alpha from global news sentiment. We process the Global Database of Events, Language, and Tone (GDELT) Project's worldwide n…
Interpretable Machine Learning