paper-with-me

홈 › Papers

Flexible Heteroscedastic Count Regression with Deep Double Poisson Networks

2024-06-13 · Spencer Young, Porter Jenkins, Longchao Da, Jeff Dotson, Hua Wei

Neural networks that can produce accurate, input-conditional uncertainty representations are critical for real-world applications. Recent progress on heteroscedastic continuous regression has shown great promise for calibrated uncertainty quantification on complex tasks, like image regression. However, when these methods are applied to discrete regression tasks, such as crowd counting, ratings prediction, or inventory estimation, they tend to produce predictive distributions with numerous pathologies. Moreover, discrete models based on the Generalized Linear Model (GLM) framework either cannot process complex input or are not fully heterosedastic. To address these issues we propose the Deep Double Poisson Network (DDPN). In contrast to networks trained to minimize Gaussian negative log likelihood (NLL), discrete network parameterizations (i.e., Poisson, Negative binomial), and GLMs, DDPN can produce discrete predictive distributions of arbitrary flexibility. Additionally, we propose a technique to tune the prioritization of mean fit and probabilistic calibration during training. We show DDPN 1) vastly outperforms existing discrete models; 2) meets or exceeds the accuracy and flexibility of networks trained with Gaussian NLL; 3) produces proper predictive distributions over discrete counts; and 4) exhibits superior out-of-distribution detection. DDPN can easily be applied to a variety of count regression datasets including tabular, image, point cloud, and text data.

📄 PDF Abstract BibTeX arXiv:2406.09262

Code (1)

delicious-ai/ddpn 공식 구현 pytorch

Tasks

Crowd CountingOut-of-Distribution DetectionregressionUncertainty Quantification

Similar Papers 제목 키워드 기반

Faithful Heteroscedastic Regression with Neural Networks

2022-12-18 · Andrew Stirn, Hans-Hermann Wessels, Megan Schertzer, Laura Pereira 외

Heteroscedastic regression models a Gaussian variable's mean and variance as a function of covariates. Parametric methods that employ neural networks for these parameter maps can capture complex relationships in the data…

regression

Double Gumbel Q-Learning

2023-09-21 · NeurIPS 2023 11

We show that Deep Neural Networks introduce two heteroscedastic Gumbel noise sources into Q-Learning. To account for these noise sources, we propose Double Gumbel Q-Learning, a Deep Q-Learning algorithm applicable for b…

Heteroscedastic Double Bayesian Elastic Net

2025-02-04 · Masanari Kimura

In many practical applications, regression models are employed to uncover relationships between predictors and a response variable, yet the common assumption of constant error variance is frequently violated. This issue …

regressionVariable Selection

A Consistent and Scalable Algorithm for Best Subset Selection in Single Index Models

2023-09-12 · Borui Tang, Jin Zhu, Junxian Zhu, Xueqin Wang 외

Analysis of high-dimensional data has led to increased interest in both single index models (SIMs) and best subset selection. SIMs provide an interpretable and flexible modeling framework for high-dimensional data, while…

Model Selectionregression

Some New Results for Poisson Binomial Models

2019-07-21 · Evan Rosenman

We consider a problem of ecological inference, in which individual-level covariates are known, but labeled data is available only at the aggregate level. The intended application is modeling voter preferences in election…

Computational Efficiency