paper-with-me

홈 › Papers

Spontaneous Spatial Cognition Emerges during Egocentric Video Viewing through Non-invasive BCI

2025-07-16 · Weichen Dai, Yuxuan Huang, Li Zhu, Dongjun Liu, Yu Zhang, Qibin Zhao, Andrzej Cichocki, Fabio Babiloni, Ke Li, Jianyu Qiu, Gangyong Jia, Wanzeng Kong, Qing Wu arxiv

Humans possess a remarkable capacity for spatial cognition, allowing for self-localization even in novel or unfamiliar environments. While hippocampal neurons encoding position and orientation are well documented, the large-scale neural dynamics supporting spatial representation, particularly during naturalistic, passive experience, remain poorly understood. Here, we demonstrate for the first time that non-invasive brain-computer interfaces (BCIs) based on electroencephalography (EEG) can decode spontaneous, fine-grained egocentric 6D pose, comprising three-dimensional position and orientation, during passive viewing of egocentric video. Despite EEG's limited spatial resolution and high signal noise, we find that spatially coherent visual input (i.e., continuous and structured motion) reliably evokes decodable spatial representations, aligning with participants' subjective sense of spatial engagement. Decoding performance further improves when visual input is presented at a frame rate of 100 ms per image, suggesting alignment with intrinsic neural temporal dynamics. Using gradient-based backpropagation through a neural decoding model, we identify distinct EEG channels contributing to position -- and orientation specific -- components, revealing a distributed yet complementary neural encoding scheme. These findings indicate that the brain's spatial systems operate spontaneously and continuously, even under passive conditions, challenging traditional distinctions between active and passive spatial cognition. Our results offer a non-invasive window into the automatic construction of egocentric spatial maps and advance our understanding of how the human mind transforms everyday sensory experience into structured internal representations.

📄 PDF Abstract BibTeX arXiv:2507.12417

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Scale-Agnostic Kolmogorov-Arnold Geometry in Neural Networks

2025-11-26 · Mathew Vanherreweghe, Michael H. Freedman, Keith M. Adams arxiv

Recent work by Freedman and Mulligan demonstrated that shallow multilayer perceptrons spontaneously develop Kolmogorov-Arnold geometric (KAG) structure during training on synthetic three-dimensional tasks. However, it re…

Egocentric Gesture Recognition Using Recurrent 3D Convolutional Neural Networks With Spatiotemporal Transformer Modules

2017-10-01 · ICCV 2017 10 · Congqi Cao, Yifan Zhang, Yi Wu, Hanqing Lu 외

Gesture is a natural interface in interacting with wearable devices such as VR/AR helmet and glasses. The main challenge of gesture recognition in egocentric vision arises from the global camera motion caused by the spon…

Gesture Recognition

Egocentric Spatial Memory

2018-07-31 · Mengmi Zhang, Keng Teck Ma, Shih-Cheng Yen, Joo Hwee Lim 외

Egocentric spatial memory (ESM) defines a memory system with encoding, storing, recognizing and recalling the spatial information about the environment from an egocentric perspective. We introduce an integrated deep neur…

Feature Engineering

Free-Form Composition Networks for Egocentric Action Recognition

2023-07-13 · Haoran Wang, Qinghua Cheng, Baosheng Yu, Yibing Zhan 외

Egocentric action recognition is gaining significant attention in the field of human action recognition. In this paper, we address data scarcity issue in egocentric action recognition from a compositional generalization …

Action RecognitionFormTemporal Action Localization

Spatial Cognition from Egocentric Video: Out of Sight, Not Out of Mind

2024-04-07 · Chiara Plizzari, Shubham Goel, Toby Perrett, Jacob Chalk 외

As humans move around, performing their daily tasks, they are able to recall where they have positioned objects in their environment, even if these objects are currently out of their sight. In this paper, we aim to mimic…