Learning Nanoscale Motion Patterns of Vesicles in Living Cells
Detecting and analyzing nanoscale motion patterns of vesicles, smaller than the microscope resolution ( 250 nm), inside living biological cells is a challenging problem. State-of-the-art CV approaches based on detection, tracking, optical flow or deep learning perform poorly for this problem. We propose an integrative approach, built upon physics based simulations, nanoscopy algorithms, and shallow residual attention network to make it possible for the first time to analysis sub-resolution motion patterns in vesicles that may also be of sub-resolution diameter. Our results show state-of-the-art performance, 89% validation accuracy on simulated dataset and 82% testing accuracy on an experimental dataset of living heart muscle cells imaged under three different pathological conditions. We demonstrate automated analysis of the motion states and changed in them for over 9000 vesicles. Such analysis will enable large scale biological studies of vesicle transport and interaction in living cells in the future.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationSimilar Papers 제목 키워드 기반
N,N,N-Trimethyl chitosan as a permeation enhancer for inhalation drug delivery: interaction with a model pulmonary surfactant
N,N,N-Trimethyl chitosan (TMC), a biocompatible and biodegradable derivative of chitosan, is currently used as a permeation enhancer to increase the translocation of drugs to the bloodstream in the lungs. This article di…
Automatic tracking of protein vesicles
With the advance of fluorescence imaging technologies, recently cell biologists are able to record the movement of protein vesicles within a living cell. Automatic tracking of the movements of these vesicles become key f…
Multiple Object TrackingObjectObject TrackingVideo Object TrackingBrain-like associative learning using a nanoscale non-volatile phase change synaptic device array
Recent advances in neuroscience together with nanoscale electronic device technology have resulted in huge interests in realizing brain-like computing hardwares using emerging nanoscale memory devices as synaptic element…
Nonequilibrium dissipation in living oocytes
Living organisms are inherently out-of-equilibrium systems. We employ new developments in stochastic energetics and rely on a minimal microscopic model to predict the amount of mechanical energy dissipated by such dynami…
Enhancing Fluorescence Correlation Spectroscopy with Machine Learning for Advanced Analysis of Anomalous Diffusion
The random motion of molecules in living cells has consistently been reported to deviate from standard Brownian motion, a behavior coined as ``anomalous diffusion''. Fluorescence Correlation Spectroscopy (FCS) is a power…