paper-with-me

홈 › Papers

AL-GTD: Deep Active Learning for Gaze Target Detection

2024-09-27 · Francesco Tonini, Nicola Dall'Asen, Lorenzo Vaquero, Cigdem Beyan, Elisa Ricci

Gaze target detection aims at determining the image location where a person is looking. While existing studies have made significant progress in this area by regressing accurate gaze heatmaps, these achievements have largely relied on access to extensive labeled datasets, which demands substantial human labor. In this paper, our goal is to reduce the reliance on the size of labeled training data for gaze target detection. To achieve this, we propose AL-GTD, an innovative approach that integrates supervised and self-supervised losses within a novel sample acquisition function to perform active learning (AL). Additionally, it utilizes pseudo-labeling to mitigate distribution shifts during the training phase. AL-GTD achieves the best of all AUC results by utilizing only 40-50% of the training data, in contrast to state-of-the-art (SOTA) gaze target detectors requiring the entire training dataset to achieve the same performance. Importantly, AL-GTD quickly reaches satisfactory performance with 10-20% of the training data, showing the effectiveness of our acquisition function, which is able to acquire the most informative samples. We provide a comprehensive experimental analysis by adapting several AL methods for the task. AL-GTD outperforms AL competitors, simultaneously exhibiting superior performance compared to SOTA gaze target detectors when all are trained within a low-data regime. Code is available at https://github.com/francescotonini/al-gtd.

📄 PDF Abstract BibTeX arXiv:2409.18561

Code (1)

francescotonini/al-gtd 공식 구현 pytorch

Tasks

Active Learning

Similar Papers 제목 키워드 기반

GazeHTA: End-to-end Gaze Target Detection with Head-Target Association

2024-04-16 · Zhi-Yi Lin, Jouh Yeong Chew, Jan van Gemert, Xucong Zhang

We propose an end-to-end approach for gaze target detection: predicting a head-target connection between individuals and the target image regions they are looking at. Most of the existing methods use independent componen…

Gaze Target Estimation

End-to-End Human-Gaze-Target Detection with Transformers

2022-03-20 · CVPR 2022 1 · Danyang Tu, Xiongkuo Min, Huiyu Duan, Guodong Guo 외

In this paper, we propose an effective and efficient method for Human-Gaze-Target (HGT) detection, i.e., gaze following. Current approaches decouple the HGT detection task into separate branches of salient object detecti…

Gaze Predictionobject-detectionObject DetectionSalient Object Detection

Object-aware Gaze Target Detection

2023-07-18 · ICCV 2023 1 · Francesco Tonini, Nicola Dall'Asen, Cigdem Beyan, Elisa Ricci

Gaze target detection aims to predict the image location where the person is looking and the probability that a gaze is out of the scene. Several works have tackled this task by regressing a gaze heatmap centered on the …

Object

Toward Gaze Target Detection of Young Autistic Children

2025-11-14 · Shijian Deng, Erin E. Kosloski, Siva Sai Nagender Vasireddy, Jia Li 외 arxiv

The automatic detection of gaze targets in autistic children through artificial intelligence can be impactful, especially for those who lack access to a sufficient number of professionals to improve their quality of life…

GazeVLM: A Vision-Language Model for Multi-Task Gaze Understanding

2025-11-09 · Athul M. Mathew, Haithem Hermassi, Thariq Khalid, Arshad Ali Khan arxiv

Gaze understanding unifies the detection of people, their gaze targets, and objects of interest into a single framework, offering critical insight into visual attention and intent estimation. Although prior research has …