Natural Image Reconstruction from fMRI using Deep Learning: A Survey
With the advent of brain imaging techniques and machine learning tools, much effort has been devoted to building computational models to capture the encoding of visual information in the human brain. One of the most challenging brain decoding tasks is the accurate reconstruction of the perceived natural images from brain activities measured by functional magnetic resonance imaging (fMRI). In this work, we survey the most recent deep learning methods for natural image reconstruction from fMRI. We examine these methods in terms of architectural design, benchmark datasets, and evaluation metrics and present a fair performance evaluation across standardized evaluation metrics. Finally, we discuss the strengths and limitations of existing studies and present potential future directions.
Code (0)
등록된 구현이 없습니다.
Tasks
Brain DecodingDeep LearningImage ReconstructionSimilar Papers 제목 키워드 기반
More Than Meets the Eye: Self-Supervised Depth Reconstruction From Brain Activity
In the past few years, significant advancements were made in reconstruction of observed natural images from fMRI brain recordings using deep-learning tools. Here, for the first time, we show that dense 3D depth maps of o…
Brain DecodingA Survey of fMRI to Image Reconstruction
Functional magnetic resonance imaging (fMRI) based image reconstruction plays a pivotal role in decoding human perception, with applications in neuroscience and brain-computer interfaces. While recent advancements in dee…
Image ReconstructionSurveyFrom voxels to pixels and back: Self-supervision in natural-image reconstruction from fMRI
Reconstructing observed images from fMRI brain recordings is challenging. Unfortunately, acquiring sufficient "labeled" pairs of {Image, fMRI} (i.e., images with their corresponding fMRI responses) to span the huge space…
DecoderImage ReconstructionBigGAN-based Bayesian reconstruction of natural images from human brain activity
In the visual decoding domain, visually reconstructing presented images given the corresponding human brain activity monitored by functional magnetic resonance imaging (fMRI) is difficult, especially when reconstructing …
Conditional Image GenerationGenerative Adversarial NetworkImage GenerationConstraint-free Natural Image Reconstruction from fMRI Signals Based on Convolutional Neural Network
In recent years, research on decoding brain activity based on functional magnetic resonance imaging (fMRI) has made remarkable achievements. However, constraint-free natural image reconstruction from brain activity is st…
Image Reconstruction