paper-with-me

Papers

Conditional Density Estimation Tools in Python and R with Applications to Photometric Redshifts and Likelihood-Free Cosmological Inference

2019-08-30 · Niccolò Dalmasso, Taylor Pospisil, Ann B. Lee, Rafael Izbicki, Peter E. Freeman, Alex I. Malz

It is well known in astronomy that propagating non-Gaussian prediction uncertainty in photometric redshift estimates is key to reducing bias in downstream cosmological analyses. Similarly, likelihood-free inference approaches, which are beginning to emerge as a tool for cosmological analysis, require a characterization of the full uncertainty landscape of the parameters of interest given observed data. However, most machine learning (ML) or training-based methods with open-source software target point prediction or classification, and hence fall short in quantifying uncertainty in complex regression and parameter inference settings. As an alternative to methods that focus on predicting the response (or parameters) $\mathbf{y}$ from features $\mathbf{x}$, we provide nonparametric conditional density estimation (CDE) tools for approximating and validating the entire probability density function (PDF) $\mathrm{p}(\mathbf{y}|\mathbf{x})$ of $\mathbf{y}$ given (i.e., conditional on) $\mathbf{x}$. As there is no one-size-fits-all CDE method, the goal of this work is to provide a comprehensive range of statistical tools and open-source software for nonparametric CDE and method assessment which can accommodate different types of settings and be easily fit to the problem at hand. Specifically, we introduce four CDE software packages in $\texttt{Python}$ and $\texttt{R}$ based on ML prediction methods adapted and optimized for CDE: $\texttt{NNKCDE}$, $\texttt{RFCDE}$, $\texttt{FlexCode}$, and $\texttt{DeepCDE}$. Furthermore, we present the $\texttt{cdetools}$ package, which includes functions for computing a CDE loss function for tuning and assessing the quality of individual PDFs, along with diagnostic functions. We provide sample code in $\texttt{Python}$ and $\texttt{R}$ as well as examples of applications to photometric redshift estimation and likelihood-free cosmological inference via CDE.

📄 PDF Abstract BibTeX arXiv:1908.11523

Code (5)

Mr8ND/cdetools_applications 공식 구현
tpospisi/DeepCDE 공식 구현 pytorch
tpospisi/NNKCDE 공식 구현
tpospisi/cdetools 공식 구현
tpospisi/rfcde 공식 구현

Tasks

AstronomyDensity EstimationDiagnosticModel SelectionPhotometric Redshift Estimation

Similar Papers 제목 키워드 기반

RFCDE: Random Forests for Conditional Density Estimation

2018-04-16 · Taylor Pospisil, Ann B. Lee

Random forests is a common non-parametric regression technique which performs well for mixed-type data and irrelevant covariates, while being robust to monotonic variable transformations. Existing random forest implement…

Density EstimationGeneral Classificationregression

Noise Contrastive Meta-Learning for Conditional Density Estimation using Kernel Mean Embeddings

2019-06-05 · Jean-Francois Ton, Lucian Chan, Yee Whye Teh, Dino Sejdinovic

Current meta-learning approaches focus on learning functional representations of relationships between variables, i.e. on estimating conditional expectations in regression. In many applications, however, we are faced wit…

Density EstimationMeta-Learningregression

Conditional Density Estimation with Neural Networks: Best Practices and Benchmarks

2019-03-03 · Jonas Rothfuss, Fabio Ferreira, Simon Walther, Maxim Ulrich

Given a set of empirical observations, conditional density estimation aims to capture the statistical relationship between a conditional variable $\mathbf{x}$ and a dependent variable $\mathbf{y}$ by modeling their condi…

Density Estimation

On Binscatter

2019-02-25 · Matias D. Cattaneo, Richard K. Crump, Max H. Farrell, Yingjie Feng

Binscatter is a popular method for visualizing bivariate relationships and conducting informal specification testing. We study the properties of this method formally and develop enhanced visualization and econometric bin…

Fast Nonparametric Conditional Density Estimation

2012-06-20 · Michael P. Holmes, Alexander G. Gray, Charles Lee Isbell

Conditional density estimation generalizes regression by modeling a full density f(yjx) rather than only the expected value E(yjx). This is important for many tasks, including handling multi-modality and generating predi…

Density EstimationPrediction Intervals