Nonparametric Density Estimation from Markov Chains
We introduce a new nonparametric density estimator inspired by Markov Chains, and generalizing the well-known Kernel Density Estimator (KDE). Our estimator presents several benefits with respect to the usual ones and can be used straightforwardly as a foundation in all density-based algorithms. We prove the consistency of our estimator and we find it typically outperforms KDE in situations of large sample size and high dimensionality. We also employ our density estimator to build a local outlier detector, showing very promising results when applied to some realistic datasets.
Code (1)
Tasks
Density EstimationSimilar Papers 제목 키워드 기반
Unbiased Derivative Estimation for Stationary Mean of Parameterized Markov chains
We propose a new approach to unbiased estimation of the gradients of the stationary means associated with parametrized families of Markov chains. Our estimators are particularly efficient when the Markov chains have slow…
Offline Estimation of Controlled Markov Chains: Minimaxity and Sample Complexity
In this work, we study a natural nonparametric estimator of the transition probability matrices of a finite controlled Markov chain. We consider an offline setting with a fixed dataset, collected using a so-called loggin…
Model-based Reinforcement LearningCovariate shift in nonparametric regression with Markovian design
Covariate shift in regression problems and the associated distribution mismatch between training and test data is a commonly encountered phenomenon in machine learning. In this paper, we extend recent results on nonparam…
regressionShape-constrained Estimation of Value Functions
We present a fully nonparametric method to estimate the value function, via simulation, in the context of expected infinite-horizon discounted rewards for Markov chains. Estimating such value functions plays an important…
Dimension-independent rates for structured neural density estimation
We show that deep neural networks achieve dimension-independent rates of convergence for learning structured densities such as those arising in image, audio, video, and text applications. More precisely, we demonstrate t…
Density Estimation