Tackling the subsampling problem to infer collective properties from limited data
Complex systems are fascinating because their rich macroscopic properties emerge from the interaction of many simple parts. Understanding the building principles of these emergent phenomena in nature requires assessing natural complex systems experimentally. However, despite the development of large-scale data-acquisition techniques, experimental observations are often limited to a tiny fraction of the system. This spatial subsampling is particularly severe in neuroscience, where only a tiny fraction of millions or even billions of neurons can be individually recorded. Spatial subsampling may lead to significant systematic biases when inferring the collective properties of the entire system naively from a subsampled part. To overcome such biases, powerful mathematical tools have been developed in the past. In this perspective, we overview some issues arising from subsampling and review recently developed approaches to tackle the subsampling problem. These approaches enable one to assess, e.g., graph structures, collective dynamics of animals, neural network activity, or the spread of disease correctly from observing only a tiny fraction of the system. However, our current approaches are still far from having solved the subsampling problem in general, and hence we conclude by outlining what we believe are the main open challenges. Solving these challenges alongside the development of large-scale recording techniques will enable further fundamental insights into the working of complex and living systems.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
HydraFormer: One Encoder For All Subsampling Rates
In automatic speech recognition, subsampling is essential for tackling diverse scenarios. However, the inadequacy of a single subsampling rate to address various real-world situations often necessitates training and depl…
AllAutomatic Speech RecognitionDecoderspeech-recognition+1Between perfectly critical and fully irregular: a reverberating model captures and predicts cortical spike propagation
Knowledge about the collective dynamics of cortical spiking is very informative about the underlying coding principles. However, even most basic properties are not known with certainty, because their assessment is hamper…
Disentangling intrinsic motion from neighbourhood effects in heterogeneous collective motion
Most real world collectives, including active particles, living cells, and grains, are heterogeneous, where individuals with differing properties interact. The differences among individuals in their intrinsic properties …
Surrogate Likelihoods for Variational Annealed Importance Sampling
Variational inference is a powerful paradigm for approximate Bayesian inference with a number of appealing properties, including support for model learning and data subsampling. By contrast MCMC methods like Hamiltonian …
Bayesian InferenceProbabilistic ProgrammingVariational InferenceOptimal Distributed Subsampling for Maximum Quasi-Likelihood Estimators with Massive Data
Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational…
Computational Efficiency