paper-with-me

홈 › Papers

Manifold Induced Biases for Zero-shot and Few-shot Detection of Generated Images

2025-04-21 · Jonathan Brokman, Amit Giloni, Omer Hofman, Roman Vainshtein, Hisashi Kojima, Guy Gilboa

Distinguishing between real and AI-generated images, commonly referred to as 'image detection', presents a timely and significant challenge. Despite extensive research in the (semi-)supervised regime, zero-shot and few-shot solutions have only recently emerged as promising alternatives. Their main advantage is in alleviating the ongoing data maintenance, which quickly becomes outdated due to advances in generative technologies. We identify two main gaps: (1) a lack of theoretical grounding for the methods, and (2) significant room for performance improvements in zero-shot and few-shot regimes. Our approach is founded on understanding and quantifying the biases inherent in generated content, where we use these quantities as criteria for characterizing generated images. Specifically, we explore the biases of the implicit probability manifold, captured by a pre-trained diffusion model. Through score-function analysis, we approximate the curvature, gradient, and bias towards points on the probability manifold, establishing criteria for detection in the zero-shot regime. We further extend our contribution to the few-shot setting by employing a mixture-of-experts methodology. Empirical results across 20 generative models demonstrate that our method outperforms current approaches in both zero-shot and few-shot settings. This work advances the theoretical understanding and practical usage of generated content biases through the lens of manifold analysis.

📄 PDF Abstract BibTeX arXiv:2504.15470

Code (1)

jonathanbrok/manifold-induced-biases-for-zero-shot-and-few-shot-detection-of-generated-images 공식 구현 pytorch

Tasks

Mixture-of-Experts

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

MIND: Decoupling Model-Induced Label Noise via Latent Manifold Disentanglement

2026-05-15 · Dayong Ren arxiv

The paradigm of learning from automatic annotations driven by pre-trained experts and Foundation Models dominates data-hungry applications. However, it introduces a critical challenge: model-induced label noise. Unlike s…

Zero-Shot Robustification of Zero-Shot Models

2023-09-08 · Dyah Adila, Changho Shin, Linrong Cai, Frederic Sala

Zero-shot inference is a powerful paradigm that enables the use of large pretrained models for downstream classification tasks without further training. However, these models are vulnerable to inherited biases that can i…

A Vision-Language Foundation Model for Zero-shot Clinical Collaboration and Automated Concept Discovery in Dermatology

2026-02-11 · Siyuan Yan, Xieji Li, Dan Mo, Philipp Tschandl 외 arxiv

Medical foundation models have shown promise in controlled benchmarks, yet widespread deployment remains hindered by reliance on task-specific fine-tuning. Here, we introduce DermFM-Zero, a dermatology vision-language fo…

Contrastive Learning

Zero-Shot Activity Recognition with Videos

2020-01-22 · Evin Pinar Ornek

In this paper, we examined the zero-shot activity recognition task with the usage of videos. We introduce an auto-encoder based model to construct a multimodal joint embedding space between the visual and textual manifol…

Action RecognitionActivity RecognitionWord EmbeddingsZero-Shot Learning

Zero-Shot Recognition using Dual Visual-Semantic Mapping Paths

2017-03-15 · CVPR 2017 7 · Yanan Li, Donghui Wang, Huanhang Hu, Yuetan Lin 외

Zero-shot recognition aims to accurately recognize objects of unseen classes by using a shared visual-semantic mapping between the image feature space and the semantic embedding space. This mapping is learned on training…

Zero-Shot Learning