Papers Gaze Prediction
“Gaze Prediction” 태그가 달린 논문 55편 · 필터 해제
EgoM2P: Egocentric Multimodal Multitask Pretraining
Understanding multimodal signals in egocentric vision, such as RGB video, depth, camera poses, and gaze, is essential for applications in augmented reality, robotics, and human-computer interaction. These capabilities en…
Depth EstimationGaze PredictionMonocular Depth EstimationDHECA-SuperGaze: Dual Head-Eye Cross-Attention and Super-Resolution for Unconstrained Gaze Estimation
Unconstrained gaze estimation is the process of determining where a subject is directing their visual attention in uncontrolled environments. Gaze estimation systems are important for a myriad of tasks such as driver dis…
Gaze EstimationGaze PredictionSuper-Resolution3D Prior is All You Need: Cross-Task Few-shot 2D Gaze Estimation
3D and 2D gaze estimation share the fundamental objective of capturing eye movements but are traditionally treated as two distinct research domains. In this paper, we introduce a novel cross-task few-shot 2D gaze estimat…
AllGaze EstimationGaze PredictionHuman Gaze Boosts Object-Centered Representation Learning
Recent self-supervised learning (SSL) models trained on human-like egocentric visual inputs substantially underperform on image recognition tasks compared to humans. These models train on raw, uniform visual inputs colle…
Gaze PredictionObjectRepresentation LearningSelf-Supervised LearningGaze Prediction as a Function of Eye Movement Type and Individual Differences
Eye movement prediction is a promising area of research with the potential to improve performance and the user experience of systems based on eye-tracking technology. In this study, we analyze individual differences in g…
Gaze PredictionPredictionRepresentation LearningEmergence of Human-Like Attention in Self-Supervised Vision Transformers: an eye-tracking study
Many models of visual attention have been proposed so far. Traditional bottom-up models, like saliency models, fail to replicate human gaze patterns, and deep gaze prediction models lack biological plausibility due to th…
Gaze PredictionEEGMobile: Enhancing Speed and Accuracy in EEG-Based Gaze Prediction with Advanced Mobile Architectures
Electroencephalography (EEG) analysis is an important domain in the realm of Brain-Computer Interface (BCI) research. To ensure BCI devices are capable of providing practical applications in the real world, brain signal …
Brain Computer InterfaceEEGGaze PredictionKnowledge Distillation+2Advancing EEG-Based Gaze Prediction Using Depthwise Separable Convolution and Enhanced Pre-Processing
In the field of EEG-based gaze prediction, the application of deep learning to interpret complex neural data poses significant challenges. This study evaluates the effectiveness of pre-processing techniques and the effec…
EEGGaze PredictionEffect of Kernel Size on CNN-Vision-Transformer-Based Gaze Prediction Using Electroencephalography Data
In this paper, we present an algorithm of gaze prediction from Electroencephalography (EEG) data. EEG-based gaze prediction is a new research topic that can serve as an alternative to traditional video-based eye-tracking…
EEGGaze PredictionPredictionLook Hear: Gaze Prediction for Speech-directed Human Attention
For computer systems to effectively interact with humans using spoken language, they need to understand how the words being generated affect the users' moment-by-moment attention. Our study focuses on the incremental pre…
DecoderGaze PredictionReferring ExpressionScanpath predictionGazing Into Missteps: Leveraging Eye-Gaze for Unsupervised Mistake Detection in Egocentric Videos of Skilled Human Activities
We address the challenge of unsupervised mistake detection in egocentric video of skilled human activities through the analysis of gaze signals. While traditional methods rely on manually labeled mistakes, our approach d…
Gaze PredictionMistake DetectionMotion Prediction with Gaussian Processes for Safe Human-Robot Interaction in Virtual Environments
Humans use collaborative robots as tools for accomplishing various tasks. The interaction between humans and robots happens in tight shared workspaces. However, these machines must be safe to operate alongside humans to …
Gaussian ProcessesGaze Predictionmotion predictionPredictionSCOUT+: Towards Practical Task-Driven Drivers' Gaze Prediction
Accurate prediction of drivers' gaze is an important component of vision-based driver monitoring and assistive systems. Of particular interest are safety-critical episodes, such as performing maneuvers or crossing inters…
Gaze PredictionPredictionData Limitations for Modeling Top-Down Effects on Drivers' Attention
Driving is a visuomotor task, i.e., there is a connection between what drivers see and what they do. While some models of drivers' gaze account for top-down effects of drivers' actions, the majority learn only bottom-up …
Gaze PredictionA Transformer-Based Model for the Prediction of Human Gaze Behavior on Videos
Eye-tracking applications that utilize the human gaze in video understanding tasks have become increasingly important. To effectively automate the process of video analysis based on eye-tracking data, it is important to …
Activity RecognitionGaze PredictionVideo UnderstandingJoint enhancement of automatic chest X-ray diagnosis and radiological gaze prediction with multi-stage cooperative learning
Purpose: As visual inspection is an inherent process during radiological screening, the associated eye gaze data can provide valuable insights into relevant clinical decisions. As deep learning has become the state-of-th…
Contrastive LearningDiagnosticGaze PredictionMulti-Task LearningA Novel Framework for Multi-Person Temporal Gaze Following and Social Gaze Prediction
Gaze following and social gaze prediction are fundamental tasks providing insights into human communication behaviors, intent, and social interactions. Most previous approaches addressed these tasks separately, either by…
Gaze PredictionGaze-Vector Estimation in the Dark with Temporally Encoded Event-driven Neural Networks
In this paper, we address the intricate challenge of gaze vector prediction, a pivotal task with applications ranging from human-computer interaction to driver monitoring systems. Our innovative approach is designed for …
Gaze PredictionCrossGaze: A Strong Method for 3D Gaze Estimation in the Wild
Gaze estimation, the task of predicting where an individual is looking, is a critical task with direct applications in areas such as human-computer interaction and virtual reality. Estimating the direction of looking in …
Gaze EstimationGaze PredictionSharingan: A Transformer Architecture for Multi-Person Gaze Following
Gaze is a powerful form of non-verbal communication that humans develop from an early age. As such modeling this behavior is an important task that can benefit a broad set of application domains ranging from robotics…
Gaze PredictionSociology