Bias-corrected estimator for intrinsic dimension and differential entropy--a visual multiscale approach
Intrinsic dimension and differential entropy estimators are studied in this paper, including their systematic bias. A pragmatic approach for joint estimation and bias correction of these two fundamental measures is proposed. Shared steps on both estimators are highlighted, along with their useful consequences to data analysis. It is shown that both estimators can be complementary parts of a single approach, and that the simultaneous estimation of differential entropy and intrinsic dimension give meaning to each other, where estimates at different observation scales convey different perspectives of underlying manifolds. Experiments with synthetic and real datasets are presented to illustrate how to extract meaning from visual inspections, and how to compensate for biases.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Manifold-adaptive dimension estimation revisited
Data dimensionality informs us about data complexity and sets limit on the structure of successful signal processing pipelines. In this work we revisit and improve the manifold-adaptive Farahmand-Szepesv\'ari-Audibert (F…
Binary Choice Models with High-Dimensional Individual and Time Fixed Effects
Empirical economists are often deterred from the application of nonlinear fixed effects models mainly for two reasons: the incidental parameter problem and the computational challenge even in moderately large panels. Usi…
Vocal Bursts Intensity PredictionBias correction and uniform inference for the quantile density function
For the kernel estimator of the quantile density function (the derivative of the quantile function), I show how to perform the boundary bias correction, establish the rate of strong uniform consistency of the bias-correc…
Estimating Dimensionality of Neural Representations from Finite Samples
The global dimensionality of a neural representation manifold provides rich insight into the computational process underlying both artificial and biological neural networks. However, all existing measures of global dimen…
Nickell Meets Stambaugh: A Tale of Two Biases in Panel Predictive Regressions
In panel predictive regressions with persistent covariates, coexistence of the Nickell bias and the Stambaugh bias imposes challenges for hypothesis testing. This paper introduces a new estimator, the IVX-X-Jackknife (IV…