paper-with-me

홈 › Papers

SymmPI: Predictive Inference for Data with Group Symmetries

2023-12-26 · Edgar Dobriban, Mengxin Yu

Quantifying the uncertainty of predictions is a core problem in modern statistics. Methods for predictive inference have been developed under a variety of assumptions, often -- for instance, in standard conformal prediction -- relying on the invariance of the distribution of the data under special groups of transformations such as permutation groups. Moreover, many existing methods for predictive inference aim to predict unobserved outcomes in sequences of feature-outcome observations. Meanwhile, there is interest in predictive inference under more general observation models (e.g., for partially observed features) and for data satisfying more general distributional symmetries (e.g., rotationally invariant or coordinate-independent observations in physics). Here we propose SymmPI, a methodology for predictive inference when data distributions have general group symmetries in arbitrary observation models. Our methods leverage the novel notion of distributional equivariant transformations, which process the data while preserving their distributional invariances. We show that SymmPI has valid coverage under distributional invariance and characterize its performance under distribution shift, recovering recent results as special cases. We apply SymmPI to predict unobserved values associated to vertices in a network, where the distribution is unchanged under relabelings that keep the network structure unchanged. In several simulations in a two-layer hierarchical model, and in an empirical data analysis example, SymmPI performs favorably compared to existing methods.

📄 PDF Abstract BibTeX arXiv:2312.16160

Code (1)

maxineyu/codes_symmpi 공식 구현

Tasks

Conformal Predictionvalid

Similar Papers 제목 키워드 기반

Conditional Predictive Inference for General Structured Data with Group Symmetries

2026-05-18 · Yichen Shen, Mengxin Yu arxiv

We study distribution-free predictive inference for data with group symmetries, aiming to establish near-conditional coverage guarantees beyond exchangeability for structured data. While many predictive inference methods…

Computational Efficiency

Data augmented bootstrap: Unifying confidence interval construction by approximate invariance

2026-06-08 · Kevin Han Huang arxiv

We propose the data augmented bootstrap (DAB), a framework for constructing confidence intervals from approximately invariant transformations of the data. As special cases, DAB recovers popular methods that rely on exact…

Data Augmentation

A Single Architecture for Representing Invariance Under Any Space Group

2025-12-16 · Cindy Y. Zhang, Elif Ertekin, Peter Orbanz, Ryan P. Adams arxiv

Incorporating known symmetries in data into machine learning models has consistently improved predictive accuracy, robustness, and generalization. However, achieving exact invariance to specific symmetries typically requ…

Zero-Shot Learning

Geometric Causal Models

2026-07-06 · Eli N. Weinstein, David M. Blei arxiv

Scientists often seek to draw causal inferences from structured data that is not independently and identically distributed, such as spatial data, network data, or molecular data. We develop geometric causal models (GCMs)…

Bayesian InferenceCausal Inference

Variational Inference Failures Under Model Symmetries: Permutation Invariant Posteriors for Bayesian Neural Networks

2024-08-10 · Yoav Gelberg, Tycho F. A. van der Ouderaa, Mark van der Wilk, Yarin Gal

Weight space symmetries in neural network architectures, such as permutation symmetries in MLPs, give rise to Bayesian neural network (BNN) posteriors with many equivalent modes. This multimodality poses a challenge for …

Variational Inference