A Cross Entropy test allows quantitative statistical comparison of t-SNE and UMAP representations
The advent of high dimensional single cell data in the biomedical sciences has necessitated the development of dimensionality-reduction tools. t-SNE and UMAP are the two most frequently used approaches, allowing clear visualisation of highly complex single cell datasets. Despite the ubiquity of these approaches and the clear need for quantitative comparison of single cell datasets, t-SNE and UMAP have largely remained data visualisation tools due to the lack of robust statistical approaches available. Here, we have derived a statistical test for evaluating the difference between dimensionality-reduced datasets, using the Kolmogorov-Smirnov test on the distributions of cross entropy of single cells within each dataset. As the approach uses the interrelationship of single cells for comparison, the resulting statistic is robust and capable of distinguishing between true biological variation and rotational symmetry generation during dimensionality reduction. Further, the test provides a valid distance between single cell datasets, allowing the organisation of multiple samples into a dendrogram for quantitative comparison of complex datasets. These results demonstrate the largely untapped potential of dimensionality-reduction tools for biomedical data analysis beyond visualisation.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionvalidSimilar Papers 제목 키워드 기반
Translation Entropy: A Statistical Framework for Evaluating Translation Systems
The translation of written language has been known since the 3rd century BC; however, its necessity has become increasingly common in the information age. Today, many translators exist, based on encoder-decoder deep arch…
Statistical inference of lead-lag at various timescales between asynchronous time series from p-values of transfer entropy
Symbolic transfer entropy is a powerful non-parametric tool to detect lead-lag between time series. Because a closed expression of the distribution of Transfer Entropy is not known for finite-size samples, statistical te…
Time SeriesTime Series AnalysisEntropy of financial time series due to the shock of war
The concept of entropy is not uniquely relevant to the statistical mechanics but among others it can play pivotal role in the analysis of a time series, particularly the stock market data. In this area sudden events are …
Time SeriesComplexity and universality in the long-range order of words
As is the case of many signals produced by complex systems, language presents a statistical structure that is balanced between order and disorder. Here we review and extend recent results from quantitative characterisati…
Maximum entropy based testing in network models: ERGMs and constrained optimization
Stochastic network models play a central role across a wide range of scientific disciplines, and questions of statistical inference arise naturally in this context. In this paper we investigate goodness-of-fit and two-sa…
Two-sample testing