paper-with-me

Papers

Unveiling the Truth: Exploring Human Gaze Patterns in Fake Images

2024-03-13 · Giuseppe Cartella, Vittorio Cuculo, Marcella Cornia, Rita Cucchiara

Creating high-quality and realistic images is now possible thanks to the impressive advancements in image generation. A description in natural language of your desired output is all you need to obtain breathtaking results. However, as the use of generative models grows, so do concerns about the propagation of malicious content and misinformation. Consequently, the research community is actively working on the development of novel fake detection techniques, primarily focusing on low-level features and possible fingerprints left by generative models during the image generation process. In a different vein, in our work, we leverage human semantic knowledge to investigate the possibility of being included in frameworks of fake image detection. To achieve this, we collect a novel dataset of partially manipulated images using diffusion models and conduct an eye-tracking experiment to record the eye movements of different observers while viewing real and fake stimuli. A preliminary statistical analysis is conducted to explore the distinctive patterns in how humans perceive genuine and altered images. Statistical findings reveal that, when perceiving counterfeit samples, humans tend to focus on more confined regions of the image, in contrast to the more dispersed observational pattern observed when viewing genuine images. Our dataset is publicly available at: https://github.com/aimagelab/unveiling-the-truth.

📄 PDF Abstract BibTeX arXiv:2403.08933

Code (1)

aimagelab/unveiling-the-truth 공식 구현

Tasks

Fake Image DetectionImage GenerationMisinformation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Gaze-Regularized VLMs for Ego-Centric Behavior Understanding

2026-03-24 · Anupam Pani, Yanchao Yang arxiv

Eye gaze, encompassing fixations and saccades, provides critical insights into human intentions and future actions. This study introduces a gaze-regularized framework that enhances Vision Language Models (VLMs) for egoce…

CausalGaze: Unveiling Hallucinations via Counterfactual Graph Intervention in Large Language Models

2026-04-13 · Linggang Kong, Lei Wu, Yunlong Zhang, Xiaofeng Zhong 외 arxiv

Despite the groundbreaking advancements made by large language models (LLMs), hallucination remains a critical bottleneck for their deployment in high-stakes domains. Existing classification-based methods mainly rely on …

Predicting Gaze in Egocentric Video by Learning Task-dependent Attention Transition

2018-03-24 · ECCV 2018 9 · Yifei Huang, Minjie Cai, Zhenqiang Li, Yoichi Sato

We present a new computational model for gaze prediction in egocentric videos by exploring patterns in temporal shift of gaze fixations (attention transition) that are dependent on egocentric manipulation tasks. Our assu…

Gaze PredictionPredictionSaliency Prediction

Tri-Cam: Practical Eye Gaze Tracking via Camera Network

2024-09-29 · Sikai Yang, Wan Du

As human eyes serve as conduits of rich information, unveiling emotions, intentions, and even aspects of an individual's health and overall well-being, gaze tracking also enables various human-computer interaction applic…

Exploring the effects of gaze and pauses in situated human-robot interaction

2013-08-01 · WS 2013 8 · Gabriel Skantze, Anna Hjalmarsson, Catharine Oertel