Gaze2Segment: A Pilot Study for Integrating Eye-Tracking Technology into Medical Image Segmentation
This study introduced a novel system, called Gaze2Segment, integrating biological and computer vision techniques to support radiologists' reading experience with an automatic image segmentation task. During diagnostic assessment of lung CT scans, the radiologists' gaze information were used to create a visual attention map. This map was then combined with a computer-derived saliency map, extracted from the gray-scale CT images. The visual attention map was used as an input for indicating roughly the location of a object of interest. With computer-derived saliency information, on the other hand, we aimed at finding foreground and background cues for the object of interest. At the final step, these cues were used to initiate a seed-based delineation process. Segmentation accuracy of the proposed Gaze2Segment was found to be 86% with dice similarity coefficient and 1.45 mm with Hausdorff distance. To the best of our knowledge, Gaze2Segment is the first true integration of eye-tracking technology into a medical image segmentation task without the need for any further user-interaction.
Code (0)
등록된 구현이 없습니다.
Tasks
DiagnosticImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
GazeSAM: What You See is What You Segment
This study investigates the potential of eye-tracking technology and the Segment Anything Model (SAM) to design a collaborative human-computer interaction system that automates medical image segmentation. We present the …
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationComputer Vision System for Eye Gaze Tracking
: Eye gaze tracking is a technique use for checking the usability problems in the Human Computer Interaction (HCI). Initially they are present tracking technology and key elements. Eye gaze tracking technique is based o…
Gaze EstimationZero-Shot Gaze-based Volumetric Medical Image Segmentation
Accurate segmentation of anatomical structures in volumetric medical images is crucial for clinical applications, including disease monitoring and cancer treatment planning. Contemporary interactive segmentation models, …
Image SegmentationInteractive SegmentationMedical Image SegmentationSegmentation+2HiFiGaze: Improving Eye Tracking Accuracy Using Screen Content Knowledge
We present a new and accurate approach for gaze estimation on consumer computing devices. We take advantage of continued strides in the quality of user-facing cameras found in e.g., smartphones, laptops, and desktops - 4…
Gaze EstimationIntegrating Eye-Gaze Data into CXR DL Approaches: A Preliminary study
This paper proposes a novel multimodal DL architecture incorporating medical images and eye-tracking data for abnormality detection in chest x-rays. Our results show that applying eye gaze data directly into DL architect…
Anomaly Detection