paper-with-me

홈 › Papers

Rapid Model Comparison by Amortizing Across Models

2019-10-16 · pproximateinference AABI Symposium 2019 12 · Lily H. Zhang, Michael C. Hughes

Comparing the inferences of diverse candidate models is an essential part of model checking and escaping local optima. To enable efficient comparison, we introduce an amortized variational inference framework that can perform fast and reliable posterior estimation across models of the same architecture. Our Any Parameter Encoder (APE) extends the encoder neural network common in amortized inference to take both a data feature vector and a model parameter vector as input. APE thus reduces posterior inference across unseen data and models to a single forward pass. In experiments comparing candidate topic models for synthetic data and product reviews, our Any Parameter Encoder yields comparable posteriors to more expensive methods in far less time, especially when the encoder architecture is designed in model-aware fashion.

📄 PDF Abstract BibTeX

Code (1)

tufts-ml/any_parameter_encoder 공식 구현

Tasks

modelTopic ModelsVariational Inference

Similar Papers 제목 키워드 기반

Deep Adaptive Design: Amortizing Sequential Bayesian Experimental Design

2021-03-03 · Adam Foster, Desi R. Ivanova, Ilyas Malik, Tom Rainforth

We introduce Deep Adaptive Design (DAD), a method for amortizing the cost of adaptive Bayesian experimental design that allows experiments to be run in real-time. Traditional sequential Bayesian optimal experimental desi…

Experimental Design

HyperInvariances: Amortizing Invariance Learning

2022-07-17 · Ruchika Chavhan, Henry Gouk, Jan Stühmer, Timothy Hospedales

Providing invariances in a given learning task conveys a key inductive bias that can lead to sample-efficient learning and good generalisation, if correctly specified. However, the ideal invariances for many problems of …

Inductive Bias

A Common Interface for Automatic Differentiation

2025-05-08 · Guillaume Dalle, Adrian Hill

For scientific machine learning tasks with a lot of custom code, picking the right Automatic Differentiation (AD) system matters. Our Julia package DifferentiationInterface.jl provides a common frontend to a dozen AD bac…

Amortized Monte Carlo Integration

2019-07-18 · Adam Goliński, Frank Wood, Tom Rainforth

Current approaches to amortizing Bayesian inference focus solely on approximating the posterior distribution. Typically, this approximation is, in turn, used to calculate expectations for one or more target functions - a…

Bayesian Inference

On Amortizing Inference Cost for Structured Prediction

2012-07-01 · EMNLP 2012 7 · Vivek Srikumar, Gourab Kundu, Dan Roth
Combinatorial OptimizationDependency ParsingPredictionSemantic Role Labeling+1