paper-with-me

Papers

Order-Agnostic Autoregressive Modelling with Missing Data

2026-05-07 · Ignacio Peis, Pablo M. Olmos, Jes Frellsen arxiv

Order-Agnostic autoregressive models have demonstrated strong performance in deep generative modeling, yet their use in settings with incomplete data remains largely unexplored. In this work, we reinterpret them through the lens of missing data. First, we show that their standard training procedure on fully observed data implicitly performs imputation under a missing completely at random mechanism, resulting in robust out-of-sample imputation performance in settings with high missingness. Second, we introduce the first principled framework for training them directly on incomplete datasets under general missingness mechanisms. Third, we leverage their amortized conditional density estimation to perform active information acquisition, i.e., sequentially selecting the most informative missing variables for downstream prediction or inference. Across a suite of real-world benchmarks, our Missingness-Aware Order-Agnostic Autoregressive Model (MO-ARM) consistently outperforms established imputation baselines.

📄 PDF Abstract BibTeX arXiv:2605.06355

Code (0)

등록된 구현이 없습니다.

Tasks

Density Estimation

Similar Papers 제목 키워드 기반

An Improved Training Procedure for Neural Autoregressive Data Completion

2017-11-23 · Maxime Voisin, Daniel Ritchie

Neural autoregressive models are explicit density estimators that achieve state-of-the-art likelihoods for generative modeling. The D-dimensional data distribution is factorized into an autoregressive product of one-dime…

EdiT5: Semi-Autoregressive Text-Editing with T5 Warm-Start

2022-05-24 · Jonathan Mallinson, Jakub Adamek, Eric Malmi, Aliaksei Severyn

We present EdiT5 - a novel semi-autoregressive text-editing model designed to combine the strengths of non-autoregressive text-editing and autoregressive decoding. EdiT5 is faster during inference than conventional seque…

DecoderGrammatical Error CorrectionSentenceSentence Fusion

The Gaussian Process Latent Autoregressive Model

2020-11-23 · pproximateinference AABI Symposium 2021 1 · Rui Xia, Wessel Bruinsma, William Tebbutt, Richard E Turner

Many real-world prediction problems involve modelling the dependencies between multiple different outputs across the input space. Multi-output Gaussian Processes (MOGP) are a particularly important approach to such probl…

DenoisingGaussian ProcessesmodelVariational Inference

Handling and Interpreting Missing Modalities in Patient Clinical Trajectories via Autoregressive Sequence Modeling

2026-04-20 · Andrew Wang, Ellie Pavlick, Ritambhara Singh arxiv

An active challenge in developing multimodal machine learning (ML) models for healthcare is handling missing modalities during training and deployment. As clinical datasets are inherently temporal and sparse in terms of …

The DEformer: An Order-Agnostic Distribution Estimating Transformer

2021-06-13 · ICML Workshop INNF 2021 7 · Michael A. Alcorn, Anh Nguyen

Order-agnostic autoregressive distribution (density) estimation (OADE), i.e., autoregressive distribution estimation where the features can occur in an arbitrary order, is a challenging problem in generative machine lear…

Density Estimation