MR-based camera-less eye tracking using deep neural networks
Viewing behavior provides a window into many central aspects of human cognition and health, and it is an important variable of interest or confound in many fMRI studies. To make eye tracking freely and widely available for MRI research, we developed DeepMReye: a convolutional neural network that decodes gaze position from the MR-signal of the eyeballs. It performs camera-less eye tracking at sub-imaging temporal resolution in held-out participants with little training data and across a broad range of scanning protocols. Critically, it works even in existing datasets and when the eyes are closed. Decoded eye movements explain network-wide brain activity also in regions not associated with oculomotor function. This work emphasizes the importance of eye tracking for the interpretation of fMRI results and provides an open-source software solution that is widely applicable in research and clinical settings.
Code (0)
등록된 구현이 없습니다.
Tasks
PositionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FlatTrack: Eye-tracking with ultra-thin lensless cameras
Existing eye trackers use cameras based on thick compound optical elements, necessitating the cameras to be placed at focusing distance from the eyes. This results in the overall bulk of wearable eye trackers, especially…
Multi-Target, Multi-Camera Tracking by Hierarchical Clustering: Recent Progress on DukeMTMC Project
Although many methods perform well in single camera tracking, multi-camera tracking remains a challenging problem with less attention. DukeMTMC is a large-scale, well-annotated multi-camera tracking benchmark which makes…
ClusteringPerson Re-IdentificationOnline Multi-camera People Tracking with Spatial-temporal Mechanism and Anchor-feature Hierarchical Clustering
Multi-camera Multi-object tracking (MTMC) surpasses conventional single-camera tracking by enabling seamless object tracking across multiple camera views. This capability is critical for security systems and improving si…
Multi-Object TrackingObjectObject TrackingAn Online Approach and Evaluation Method for Tracking People Across Cameras in Extremely Long Video Sequence
Multi-camera Multi-Object Tracking has drawn significant attention in recent years due to its critical role in surveillance analytics and related fields. Various challenges including non-overlapping regions varying occlu…
Camera CalibrationDomain GeneralizationMulti-Object TrackingObject TrackingMMPTRACK: Large-scale Densely Annotated Multi-camera Multiple People Tracking Benchmark
Multi-camera tracking systems are gaining popularity in applications that demand high-quality tracking results, such as frictionless checkout because monocular multi-object tracking (MOT) systems often fail in cluttered …
Multi-Object TrackingMultiple People TrackingObject TrackingPerson Re-Identification