Deep Markov Factor Analysis: Towards Concurrent Temporal and Spatial Analysis of fMRI Data
Factor analysis methods have been widely used in neuroimaging to transfer high dimensional imaging data into low dimensional, ideally interpretable representations. However, most of these methods overlook the highly nonlinear and complex temporal dynamics of neural processes when factorizing their imaging data. In this paper, we present deep Markov factor analysis (DMFA), a generative model that employs Markov property in a chain of low dimensional temporal embeddings together with spatial inductive assumptions, all related through neural networks, to capture temporal dynamics in functional magnetic resonance imaging (fMRI) data, and tackle their high spatial dimensionality, respectively. Augmented with a discrete latent, DMFA is able to cluster fMRI data in its low dimensional temporal embedding with regard to subject and cognitive state variability, therefore, enables validation of a variety of fMRI-driven neuroscientific hypotheses. Experimental results on both synthetic and real fMRI data demonstrate the capacity of DMFA in revealing interpretable clusters and capturing nonlinear temporal dependencies in these high dimensional imaging data.
Code (1)
Similar Papers 제목 키워드 기반
Deep Markov Spatio-Temporal Factorization
We introduce deep Markov spatio-temporal factorization (DMSTF), a generative model for dynamical analysis of spatio-temporal data. Like other factor analysis methods, DMSTF approximates high dimensional data by a product…
ClusteringTime SeriesTime Series AnalysisTime Series Clustering+2STIGCN: spatial–temporal interaction‑aware graph convolution network for pedestrian trajectory prediction
Accurately predicting the future trajectory of pedestrians is critical for tasks such as autonomous driving and robot navigation. Previous methods for pedestrian trajectory prediction dealt with social interaction and pe…
Autonomous DrivingPedestrian Trajectory PredictionPredictionRobot Navigation+1Temporal-Spatial Decouple before Act: Disentangled Representation Learning for Multimodal Sentiment Analysis
Multimodal Sentiment Analysis integrates Linguistic, Visual, and Acoustic. Mainstream approaches based on modality-invariant and modality-specific factorization or on complex fusion still rely on spatiotemporal mixed mod…
Multimodal Sentiment AnalysisRepresentation LearningAnalysis of Massive Heterogeneous Temporal-Spatial Data with 3D Self-Organizing Map and Time Vector
Self-organizing map(SOM) have been widely applied in clustering, this paper focused on centroids of clusters and what they reveal. When the input vectors consists of time, latitude and longitude, the map can be strongly …
ClusteringTri-axial Self-Attention for Concurrent Activity Recognition
We present a system for concurrent activity recognition. To extract features associated with different activities, we propose a feature-to-activity attention that maps the extracted global features to sub-features associ…
Action DetectionActivity DetectionActivity PredictionActivity Recognition+3