paper-with-me

홈 › Papers

Deep Markov Factor Analysis: Towards Concurrent Temporal and Spatial Analysis of fMRI Data

2021-12-01 · NeurIPS 2021 12 · Amirreza Farnoosh, Sarah Ostadabbas

Factor analysis methods have been widely used in neuroimaging to transfer high dimensional imaging data into low dimensional, ideally interpretable representations. However, most of these methods overlook the highly nonlinear and complex temporal dynamics of neural processes when factorizing their imaging data. In this paper, we present deep Markov factor analysis (DMFA), a generative model that employs Markov property in a chain of low dimensional temporal embeddings together with spatial inductive assumptions, all related through neural networks, to capture temporal dynamics in functional magnetic resonance imaging (fMRI) data, and tackle their high spatial dimensionality, respectively. Augmented with a discrete latent, DMFA is able to cluster fMRI data in its low dimensional temporal embedding with regard to subject and cognitive state variability, therefore, enables validation of a variety of fMRI-driven neuroscientific hypotheses. Experimental results on both synthetic and real fMRI data demonstrate the capacity of DMFA in revealing interpretable clusters and capturing nonlinear temporal dependencies in these high dimensional imaging data.

📄 PDF Abstract BibTeX

Code (1)

ostadabbas/deep-markov-factor-analysis-dmfa- 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Deep Markov Spatio-Temporal Factorization

2020-03-22 · Amirreza Farnoosh, Behnaz Rezaei, Eli Zachary Sennesh, Zulqarnain Khan 외

We introduce deep Markov spatio-temporal factorization (DMSTF), a generative model for dynamical analysis of spatio-temporal data. Like other factor analysis methods, DMSTF approximates high dimensional data by a product…

ClusteringTime SeriesTime Series AnalysisTime Series Clustering+2

STIGCN: spatial–temporal interaction‑aware graph convolution network for pedestrian trajectory prediction

2023-12-30 · The Journal of Supercomputing 2023 12 · Wangxing Chen, Haifeng Sang, Jinyu Wang, Zishan Zhao

Accurately predicting the future trajectory of pedestrians is critical for tasks such as autonomous driving and robot navigation. Previous methods for pedestrian trajectory prediction dealt with social interaction and pe…

Autonomous DrivingPedestrian Trajectory PredictionPredictionRobot Navigation+1

Temporal-Spatial Decouple before Act: Disentangled Representation Learning for Multimodal Sentiment Analysis

2026-01-20 · Chunlei Meng, Ziyang Zhou, Lucas He, Xiaojing Du 외 arxiv

Multimodal Sentiment Analysis integrates Linguistic, Visual, and Acoustic. Mainstream approaches based on modality-invariant and modality-specific factorization or on complex fusion still rely on spatiotemporal mixed mod…

Multimodal Sentiment AnalysisRepresentation Learning

Analysis of Massive Heterogeneous Temporal-Spatial Data with 3D Self-Organizing Map and Time Vector

2016-09-27 · Yu Ding

Self-organizing map(SOM) have been widely applied in clustering, this paper focused on centroids of clusters and what they reveal. When the input vectors consists of time, latitude and longitude, the map can be strongly …

Clustering

Tri-axial Self-Attention for Concurrent Activity Recognition

2018-12-06 · Yanyi Zhang, Xinyu Li, Kaixiang Huang, Yehan Wang 외

We present a system for concurrent activity recognition. To extract features associated with different activities, we propose a feature-to-activity attention that maps the extracted global features to sub-features associ…

Action DetectionActivity DetectionActivity PredictionActivity Recognition+3