paper-with-me

홈 › Papers

Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizable

2025-05-20 · Ruoxin Chen, Junwei Xi, Zhiyuan Yan, Ke-Yue Zhang, Shuang Wu, Jingyi Xie, Xu Chen, Lei Xu, Isabel Guan, Taiping Yao, Shouhong Ding

Existing detectors are often trained on biased datasets, leading to the possibility of overfitting on non-causal image attributes that are spuriously correlated with real/synthetic labels. While these biased features enhance performance on the training data, they result in substantial performance degradation when applied to unbiased datasets. One common solution is to perform dataset alignment through generative reconstruction, matching the semantic content between real and synthetic images. However, we revisit this approach and show that pixel-level alignment alone is insufficient. The reconstructed images still suffer from frequency-level misalignment, which can perpetuate spurious correlations. To illustrate, we observe that reconstruction models tend to restore the high-frequency details lost in real images (possibly due to JPEG compression), inadvertently creating a frequency-level misalignment, where synthetic images appear to have richer high-frequency content than real ones. This misalignment leads to models associating high-frequency features with synthetic labels, further reinforcing biased cues. To resolve this, we propose Dual Data Alignment (DDA), which aligns both the pixel and frequency domains. Moreover, we introduce two new test sets: DDA-COCO, containing DDA-aligned synthetic images for testing detector performance on the most aligned dataset, and EvalGEN, featuring the latest generative models for assessing detectors under new generative architectures such as visual auto-regressive generators. Finally, our extensive evaluations demonstrate that a detector trained exclusively on DDA-aligned MSCOCO could improve across 8 diverse benchmarks by a non-trivial margin, showing a +7.2% on in-the-wild benchmarks, highlighting the improved generalizability of unbiased detectors.

📄 PDF Abstract BibTeX arXiv:2505.14359

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Using Residual Dipolar Couplings from Two Alignment Media to Detect Structural Homology

2019-11-06 · Ryan Yandle, Rishi Mukhopadhyay, Homayoun Valafar

The method of Probability Density Profile Analysis has been introduced previously as a tool to find the best match between a set of experimentally generated Residual Dipolar Couplings and a set of known protein structure…

Protein Folding

Towards Better Alignment: Training Diffusion Models with Reinforcement Learning Against Sparse Rewards

2025-03-14 · CVPR 2025 1 · Zijing Hu, Fengda Zhang, Long Chen, Kun Kuang 외

Diffusion models have achieved remarkable success in text-to-image generation. However, their practical applications are hindered by the misalignment between generated images and corresponding text prompts. To tackle thi…

DenoisingImage GenerationReinforcement Learning (RL)Text to Image Generation+1

Visual question answering based evaluation metrics for text-to-image generation

2024-11-15 · Mizuki Miyamoto, Ryugo Morita, Jinjia Zhou

Text-to-image generation and text-guided image manipulation have received considerable attention in the field of image generation tasks. However, the mainstream evaluation methods for these tasks have difficulty in evalu…

Image GenerationImage ManipulationImage Quality AssessmentNR-IQA+5

Symbal: Detecting Systematic Misalignments in Model-Generated Captions

2026-07-16 · Maya Varma, Jean-Benoit Delbrouck, Sophie Ostmeier, Akshay Chaudhari 외 arxiv

Multimodal large language models (MLLMs) often introduce errors when generating image captions, resulting in misaligned image-text pairs. Our work focuses on a class of captioning errors that we refer to as systematic mi…

What Makes a Good Generated Image? Investigating Human and Multimodal LLM Image Preference Alignment

2025-09-16 · Rishab Parthasarathy, Jasmine Collins, Cory Stephenson arxiv

Automated evaluation of generative text-to-image models remains a challenging problem. Recent works have proposed using multimodal LLMs to judge the quality of images, but these works offer little insight into how multim…