BrainPredict: a Tool for Predicting and Visualising Local Brain Activity
In this paper, we present a tool allowing dynamic prediction and visualization of an individual{'}s local brain activity during a conversation. The prediction module of this tool is based on classifiers trained using a corpus of human-human and human-robot conversations including fMRI recordings. More precisely, the module takes as input behavioral features computed from raw data, mainly the participant and the interlocutor speech but also the participant{'}s visual input and eye movements. The visualisation module shows in real-time the dynamics of brain active areas synchronised with the behavioral raw data. In addition, it shows which integrated behavioral features are used to predict the activity in individual brain areas.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
RepGraph: Visualising and Analysing Meaning Representation Graphs
We present RepGraph, an open source visualisation and analysis tool for meaning representation graphs. Graph-based meaning representations provide rich semantic annotations, but visualising them clearly is more challengi…
Brain Multigraph Prediction using Topology-Aware Adversarial Graph Neural Network
Brain graphs (i.e, connectomes) constructed from medical scans such as magnetic resonance imaging (MRI) have become increasingly important tools to characterize the abnormal changes in the human brain. Due to the high ac…
Generative Adversarial NetworkGraph GenerationGraph Neural NetworkDiRe-RAPIDS: Topology-faithful dimensionality reduction at scale
Dimensionality reduction methods such as UMAP and t-SNE are central tools for visualising high-dimensional data, but their local-neighborhood objectives can preserve sampling noise while distorting global topology. We sh…
Dimensionality ReductionBrain Structure-Function Fusing Representation Learning using Adversarial Decomposed-VAE for Analyzing MCI
Integrating the brain structural and functional connectivity features is of great significance in both exploring brain science and analyzing cognitive impairment clinically. However, it remains a challenge to effectively…
Functional ConnectivityRepresentation LearningPraaline: Integrating Tools for Speech Corpus Research
This paper presents Praaline, an open-source software system for managing, annotating, analysing and visualising speech corpora. Researchers working with speech corpora are often faced with multiple tools and formats, an…