paper-with-me

Papers

Multivariate Density Estimation via Variance-Reduced Sketching

2024-01-22 · Yifan Peng, Yuehaw Khoo, Daren Wang

Multivariate density estimation is of great interest in various scientific and engineering disciplines. In this work, we introduce a new framework called Variance-Reduced Sketching (VRS), specifically designed to estimate multivariate density functions with a reduced curse of dimensionality. Our VRS framework conceptualizes multivariate functions as infinite-size matrices/tensors, and facilitates a new sketching technique motivated by the numerical linear algebra literature to reduce the variance in density estimation problems. We demonstrate the robust numerical performance of VRS through a series of simulated experiments and real-world data applications. Notably, VRS shows remarkable improvement over existing neural network density estimators and classical kernel methods in numerous distribution models. Additionally, we offer theoretical justifications for VRS to support its ability to deliver density estimation with a reduced curse of dimensionality.

📄 PDF Abstract BibTeX arXiv:2401.11646

Code (1)

ivanpeng0414/nonparametric-estimation-via-variance-reduced-sketching 공식 구현 pytorch

Tasks

Density Estimationregression

Similar Papers 제목 키워드 기반

Spectral estimation from simulations via sketching

2020-07-21 · Zhishen Huang, Stephen Becker

Sketching is a stochastic dimension reduction method that preserves geometric structures of data and has applications in high-dimensional regression, low rank approximation and graph sparsification. In this work, we show…

Dimensionality Reductionregression

Geometric Estimation of Multivariate Dependency

2019-05-21 · Salimeh Yasaei Sekeh, Alfred O. Hero

This paper proposes a geometric estimator of dependency between a pair of multivariate samples. The proposed estimator of dependency is based on a randomly permuted geometric graph (the minimal spanning tree) over the tw…

Density Estimation

Doubly Robust Bias Reduction in Infinite Horizon Off-Policy Estimation

2019-10-16 · ICLR 2020 1 · Ziyang Tang, Yihao Feng, Lihong Li, Dengyong Zhou 외

Infinite horizon off-policy policy evaluation is a highly challenging task due to the excessively large variance of typical importance sampling (IS) estimators. Recently, Liu et al. (2018a) proposed an approach that sign…

Density Ratio EstimationOff-policy evaluation

Fast and Extensible Online Multivariate Kernel Density Estimation

2016-06-08 · Jaime Ferreira, David Martins de Matos, Ricardo Ribeiro

We present xokde++, a state-of-the-art online kernel density estimation approach that maintains Gaussian mixture models input data streams. The approach follows state-of-the-art work on online density estimation, but was…

Computational EfficiencyDensity Estimation

Multivariate Uncertainty in Deep Learning

2019-10-31 · Rebecca L. Russell, Christopher Reale

Deep learning has the potential to dramatically impact navigation and tracking state estimation problems critical to autonomous vehicles and robotics. Measurement uncertainties in state estimation systems based on Kalman…

Autonomous VehiclesDeep LearningPose EstimationState Estimation+3