Cross-Modal Computational Model of Brain-Heart Interactions via HRV and EEG Feature
The electroencephalogram (EEG) has been the gold standard for quantifying mental workload; however, due to its complexity and non-portability, it can be constraining. ECG signals, which are feasible on wearable equipment pieces such as headbands, present a promising method for cognitive state monitoring. This research explores whether electrocardiogram (ECG) signals are able to indicate mental workload consistently and act as surrogates for EEG-based cognitive indicators. This study investigates whether ECG-derived features can serve as surrogate indicators of cognitive load, a concept traditionally quantified using EEG. Using a publicly available multimodal dataset (OpenNeuro) of EEG and ECG recorded during working-memory and listening tasks, features of HRV and Catch22 descriptors are extracted from ECG, and spectral band-power with Catch22 features from EEG. A cross-modal regression framework based on XGBoost was trained to map ECG-derived HRV representations to EEG-derived cognitive features. In order to address data sparsity and model brain-heart interactions, we integrated the PSV-SDG to produce EEG-conditioned synthetic HRV time series.This addresses the challenge of inferring cognitive load solely from ECG-derived features using a combination of multimodal learning, signal processing, and synthetic data generation. These outcomes form a basis for light, interpretable machine learning models that are implemented through wearable biosensors in non-lab environments. Synthetic HRV inclusion enhances robustness, particularly in sparse data situations. Overall, this work is an initiation for building low-cost, explainable, and real-time cognitive monitoring systems for mental health, education, and human-computer interaction, with a focus on ageing and clinical populations.
Code (0)
등록된 구현이 없습니다.
Tasks
Interpretable Machine LearningSynthetic Data GenerationSimilar Papers 제목 키워드 기반
Measures and Models of Brain-Heart Interactions
The exploration of brain-heart interactions within various paradigms, including affective computing, human-computer interfaces, and sensorimotor evaluation, stands as a significant milestone in biomarker development and …
Joint data imputation and mechanistic modelling for simulating heart-brain interactions in incomplete datasets
The use of mechanistic models in clinical studies is limited by the lack of multi-modal patients data representing different anatomical and physiological processes. For example, neuroimaging datasets do not provide a suf…
AnatomyImputationPan-FM: A Pan-Organ Foundation Model with Saliency-Guided Masking for Missing Robustness
Foundation models (FMs) have shown great promise in medical imaging, but most FMs are trained on unimodal data within isolated domains, such as brain MRI alone. Human aging and disease arise through coordinated biologica…
Self-Supervised LearningRepresentation LearningHuman AgingModeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI
Brain MRI poses a fundamental challenge for machine learning: models must learn from high-dimensional 3D data spanning multiple co-registered modalities, despite the limited sample sizes typical of neuroimaging studies r…
Representation LearningA Graph Neural Network Framework for Causal Inference in Brain Networks
A central question in neuroscience is how self-organizing dynamic interactions in the brain emerge on their relatively static structural backbone. Due to the complexity of spatial and temporal dependencies between differ…
Causal InferenceGraph Neural Network