paper-with-me

Papers

Natural Image Reconstruction from fMRI using Deep Learning: A Survey

2021-10-18 · journal 2021 1 · Zarina Rakhimberdina, Quentin Jodelet, Xin Liu, Tsuyoshi Murata

With the advent of brain imaging techniques and machine learning tools, much effort has been devoted to building computational models to capture the encoding of visual information in the human brain. One of the most challenging brain decoding tasks is the accurate reconstruction of the perceived natural images from brain activities measured by functional magnetic resonance imaging (fMRI). In this work, we survey the most recent deep learning methods for natural image reconstruction from fMRI. We examine these methods in terms of architectural design, benchmark datasets, and evaluation metrics and present a fair performance evaluation across standardized evaluation metrics. Finally, we discuss the strengths and limitations of existing studies and present potential future directions.

📄 PDF Abstract BibTeX arXiv:2110.09006

Code (0)

등록된 구현이 없습니다.

Tasks

Brain DecodingDeep LearningImage Reconstruction

Similar Papers 제목 키워드 기반

More Than Meets the Eye: Self-Supervised Depth Reconstruction From Brain Activity

2021-06-09 · Guy Gaziv, Michal Irani

In the past few years, significant advancements were made in reconstruction of observed natural images from fMRI brain recordings using deep-learning tools. Here, for the first time, we show that dense 3D depth maps of o…

Brain Decoding

A Survey of fMRI to Image Reconstruction

2025-02-24 · Weiyu Guo, Guoying Sun, Jianxiang He, Tong Shao 외

Functional magnetic resonance imaging (fMRI) based image reconstruction plays a pivotal role in decoding human perception, with applications in neuroscience and brain-computer interfaces. While recent advancements in dee…

Image ReconstructionSurvey

From voxels to pixels and back: Self-supervision in natural-image reconstruction from fMRI

2019-07-03 · NeurIPS 2019 12 · Roman Beliy, Guy Gaziv, Assaf Hoogi, Francesca Strappini 외

Reconstructing observed images from fMRI brain recordings is challenging. Unfortunately, acquiring sufficient "labeled" pairs of {Image, fMRI} (i.e., images with their corresponding fMRI responses) to span the huge space…

DecoderImage Reconstruction

BigGAN-based Bayesian reconstruction of natural images from human brain activity

2020-03-13 · Kai Qiao, Jian Chen, Linyuan Wang, Chi Zhang 외

In the visual decoding domain, visually reconstructing presented images given the corresponding human brain activity monitored by functional magnetic resonance imaging (fMRI) is difficult, especially when reconstructing …

Conditional Image GenerationGenerative Adversarial NetworkImage Generation

Constraint-free Natural Image Reconstruction from fMRI Signals Based on Convolutional Neural Network

2018-01-16 · Chi Zhang, Kai Qiao, Linyuan Wang, Li Tong 외

In recent years, research on decoding brain activity based on functional magnetic resonance imaging (fMRI) has made remarkable achievements. However, constraint-free natural image reconstruction from brain activity is st…

Image Reconstruction