paper-with-me

Papers

Sourcerer: Sample-based Maximum Entropy Source Distribution Estimation

2024-02-12 · Julius Vetter, Guy Moss, Cornelius Schröder, Richard Gao, Jakob H. Macke

Scientific modeling applications often require estimating a distribution of parameters consistent with a dataset of observations - an inference task also known as source distribution estimation. This problem can be ill-posed, however, since many different source distributions might produce the same distribution of data-consistent simulations. To make a principled choice among many equally valid sources, we propose an approach which targets the maximum entropy distribution, i.e., prioritizes retaining as much uncertainty as possible. Our method is purely sample-based - leveraging the Sliced-Wasserstein distance to measure the discrepancy between the dataset and simulations - and thus suitable for simulators with intractable likelihoods. We benchmark our method on several tasks, and show that it can recover source distributions with substantially higher entropy than recent source estimation methods, without sacrificing the fidelity of the simulations. Finally, to demonstrate the utility of our approach, we infer source distributions for parameters of the Hodgkin-Huxley model from experimental datasets with thousands of single-neuron measurements. In summary, we propose a principled method for inferring source distributions of scientific simulator parameters while retaining as much uncertainty as possible.

📄 PDF Abstract BibTeX arXiv:2402.07808

Code (1)

mackelab/sourcerer 공식 구현 pytorch

Tasks

valid

Similar Papers 제목 키워드 기반

A Bayesian-inspired, deep learning-based, semi-supervised domain adaptation technique for land cover mapping

2020-05-25 · Benjamin Lucas, Charlotte Pelletier, Daniel Schmidt, Geoffrey I. Webb 외

Land cover maps are a vital input variable to many types of environmental research and management. While they can be produced automatically by machine learning techniques, these techniques require substantial training da…

Domain AdaptationManagementSemi-supervised Domain AdaptationTime Series Analysis

MGD: Moment Guided Diffusion for Maximum Entropy Generation

2026-02-19 · Etienne Lempereur, Nathanaël Cuvelle--Magar, Florentin Coeurdoux, Stéphane Mallat 외 arxiv

Generating samples from limited information is a fundamental problem across scientific domains. Classical maximum entropy methods provide principled uncertainty quantification from moment constraints but require sampling…

Out-of-Distribution Detection using Maximum Entropy Coding

2024-04-25 · Mojtaba Abolfazli, Mohammad Zaeri Amirani, Anders Høst-Madsen, June Zhang 외

Given a default distribution $P$ and a set of test data $x^M=\{x_1,x_2,\ldots,x_M\}$ this paper seeks to answer the question if it was likely that $x^M$ was generated by $P$. For discrete distributions, the definitive an…

Out-of-Distribution Detection

MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation

2023-06-07 · Tony Tohme, Mohsen Sadr, Kamal Youcef-Toumi, Nicolas G. Hadjiconstantinou

We introduce MESSY estimation, a Maximum-Entropy based Stochastic and Symbolic densitY estimation method. The proposed approach recovers probability density functions symbolically from samples using moments of a Gradient…

Density EstimationSymbolic Regression

Gaussian Max-Value Entropy Search for Multi-Agent Bayesian Optimization

2023-03-10 · Haitong Ma, Tianpeng Zhang, Yixuan Wu, Flavio P. Calmon 외

We study the multi-agent Bayesian optimization (BO) problem, where multiple agents maximize a black-box function via iterative queries. We focus on Entropy Search (ES), a sample-efficient BO algorithm that selects querie…

Bayesian OptimizationComputational Efficiency