Inverse reinforcement learning conditioned on brain scan
We outline a way for an agent to learn the dispositions of a particular individual through inverse reinforcement learning where the state space at time t includes an fMRI scan of the individual, to represent his brain state at that time. The fundamental assumption being that the information shown on an fMRI scan of an individual is conditioned on his thoughts and thought processes. The system models both long and short term memory as well any internal dynamics we may not be aware of that are in the human brain. The human expert will put on a suit for a set duration with sensors whose information will be used to train a policy network, while a generative model will be trained to produce the next fMRI scan image conditioned on the present one and the state of the environment. During operation the humanoid robots actions will be conditioned on this evolving fMRI and the environment it is in.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
InverseSR: 3D Brain MRI Super-Resolution Using a Latent Diffusion Model
High-resolution (HR) MRI scans obtained from research-grade medical centers provide precise information about imaged tissues. However, routine clinical MRI scans are typically in low-resolution (LR) and vary greatly in c…
DecoderDenoisingMRI ReconstructionSuper-ResolutionTemporary changes in large-scale memory neural networks after fear learning and extinction in healthy adults
The analysis of the functional connectivity of brain sections associated with fear-conditioned training is one of the methods of study of memory neural networks. Before, the majority of studies focused on the functional …
Functional ConnectivityHippocampusFrom Language to Goals: Inverse Reinforcement Learning for Vision-Based Instruction Following
Reinforcement learning is a promising framework for solving control problems, but its use in practical situations is hampered by the fact that reward functions are often difficult to engineer. Specifying goals and tasks …
Instruction Followingreinforcement-learningReinforcement LearningReinforcement Learning (RL)A Generative Diffusion Model to Solve Inverse Problems for Robust in-NICU Neonatal MRI
We present the first acquisition-agnostic diffusion generative model for Magnetic Resonance Imaging (MRI) in the neonatal intensive care unit (NICU) to solve a range of inverse problems for shortening scan time and impro…
Super-ResolutionMulti-Modality Conditioned Variational U-Net for Field-of-View Extension in Brain Diffusion MRI
An incomplete field-of-view (FOV) in diffusion magnetic resonance imaging (dMRI) can severely hinder the volumetric and bundle analyses of whole-brain white matter connectivity. Although existing works have investigated …
Diffusion MRIImputation